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(54) TiUe: SYSTEMS AND METHODS WITH IDENTITY VERIFICATION BY COMPARISON AND INTERPRETATION OF SKIN 
PATTIERNS SUCH AS FINGERPRINTS 

(57) Abstract 

A sensor receives a print image from an authorized person 
(21) to form a template, and from a candidate (li) to form 
test data. Noise variance (12) is estimated from the test data 
as a function of position in the image, and used to weight the 
importance of comparison with the template at each position. 
Test data are multilevel, and are l>andpassed and normalized 
(13) and expressed as local sinusoids for comparison. A ridge 
spacing and direction map (28) of the template is stored as vector 
wavenumber fields, which are later used to refine comparison. 
Global dilation (34) and also differential distortions (45) of 
the test image are estimated, and taken into account in the 
comparison. Comparison yields a test statistic (52) that is the 
ratio, or log of the ratio, of the likelihoods of obtaining the test 
image assuming that it respectively was, and was not, formed by 
an authorized user. The test statistic is compared with a threshold 
value, preselected for a desired level of certainty, to make the 
verification decision. 
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SYSTEMS & METHODS WITH IDENTITY VERIFICATION BY COMPARISON 
& INTERPRETATION OF SKIN PATTERNS SUCH AS FINGERPRINTS 



5 RELATED PATENT APPLICATIONS 

Two coowned patent docvunents of Arete Associates, Inc., are 
wholly incorporated by reference herein: PCT/US96/0161S , based on a 
U. S. application of Bowker and Lubard; and copending attorney docket 
10 xAA-38, filed in the PCT concurrently herewith on September 8, 1997, 
based on a U. S, application of Bowker et al . . and entitled "ECONCM4I- 
CAL SKIN-PATTERN-ACQUISITION APPARATUS FOR ACCESS CONTROL; SYSTEMS 
CONTROLLED THEREBY", later made PCT/US97/ . 



16 

FIELD OF THE INVENTION 

This invention relates generally to systems and methods for 
verifying identity of people, by comparison and interpretation of skin 

20 patterns such as fingerprints; and more particularly to novel firmware 
and software stored in apparatus memories , as portions of apparatus , 
for interpreting such patterns and controlling utilization devices. 
With respect to certain of the appended claims, the invention further 
relates to systems that include such utilization devices. 

26 A utilization device is, for example, a facility, apparatus, 

means for providing a financial service, or means for providing 
information. The phrase ^^utilization device" thus encompasses, but is 
not limited to, businesses, homes, vehicles, automatic teller ma- 
chines, tiroe-and*attendance systems, database- searching services, and 

30 a great many other practical systems. An apparatus memory for such 
storage is, for example, a progrcunmable read-only memory ("PROM") , or 
a conputer- readable disc. 

J5 BACKGROUND OF THE INVENTION 

Classical methods for evaluation of fingerprints, toeprints, 
palnprints and like skin patterns entail location, categorization and 
tabulation of minutiae are fundamentally limited by their sensitivity 
40 to measurement noise at the location of the miniutiae. Automated 

analysis based on minutiae also is inherently very dependent on image 
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enhancement — which often breaks down when initial data quality is 
marginal . 

A few relatively sophisticated patents use digital coitputers to 

(1) automatically select one or more distinctive small regions not 

5 necessarily minutiae in a master print or ^'template", and then (2) 

automatically look for one or more of these selected small regions in 
a print provided by a person who purports to be the maker of the 
template. These earlier patents particularly include U. S. 5,067,162 
of Driscoll, 5,040,223 of Kamiya, 4,982,439 of Castelaz, 4,805,223 of 
fO Denyer, and 4,803,734 of Onishi. 

All of these latter patents describe making final verification 
decisions based upon such comparisons of small regions. They depend 
excessively upon isolated, small amounts of data — very small frac- 
tions of the available information in a candidate user's print. 
fS Some of the patents in the above list do describe sound tech- 

niques for one or another part of their respective processes. Some 
workers, such as Driscoll and Kamiya, use electronic correlation meth- 
ods to choose the small reference sections in the enrollment process 

i . e . . in forming the template — and also in con^arison of those 

to regions with features in a candidate user's print. Denyer similarly 
uses an approximation to such correlation technique. 

These patents do generally allow for the possibility that the 
authorized user's ten^alate may be shifted, or in other words trans- 
lated, in placement of the print image on the sensor. Some (particu- 
25 larly Driscoll and Denyer) allow for the possibility that the template 
may be rotated too . 

Driscoll discusses finding a least-squares -fit between plural 
reference regions and a potentially corresponding plurality of test 
regions in the candidate print. He suggests that departures from an 
ZQ ideal rotated pattern of the reference regions is to be accounted for 
by distortion of the fingertip in the course of placement on a sensor, 
but by his least-squares approach also suggests that such distortion 
is inherently "random" in the sense of lacking internal correlation. 

Whereas distortions of f lesh-and-skin structures are in fact ran- 
J5 dom in the sense of being modeled or modelable statistically, proper 
efforts at such modeling must take into account that neighboring por- 
tions of the structure exert influences upon one another, resulting in 
physical correlations. In short, neighbors are softly constrained. 

Driscoll' s approach, in using a least-squares fit to accommo- 

40 date departures from a rigid rotation that underlies the distortion 

in essence disregards such correlations; at best, he only considers a 
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small part: of the operative statistics. Denyer, too, briefly mentions 
(though in a much more generalized and tangential way) the possibility 
of somehow accounting for distortion. 

All of these patents, however, fail to take account of dilations 
5 (or, to put it more conpletely, dilations or contractions) which an 
authorized user's fingertip may undergo — relative to the same user's 
established template. Such dilations may arise from variations in the 
pressure with which the finger is applied to an optical or other 
sensor (capacitive, variable-resistance etc.). 

Such dilations may be expected to have at least a component which 
is invariant across the entire image, in other words a dilation with- 
out change of fingerprint shape an isomorphic dilation. Further- 
more all the above-mentioned patents fail to make systematic, con- 
trolled allowance for dilations and other forms of distortion that are 

*5 differ ential which is to say, nonisomorphic . 

Correlation methods, matched- filter methods, and (loosely speak- 
ing) related overlay-style techniques of comparison all fail totally 
in any area where a reference print is mismatched to a candidate print 
by as little as a quarter of the spacing between ridges . I have found 
20 that dilations and other distortions can and commonly do produce 

spurious mismatches locally over sizable areas — exceeding twice 

the spacing between ridges, that is, many times the minimum disruption 
which destroys correlation and thereby recognition. 

Therefore, failure to account properly for either dilation (iso- 
25 morphic distortion) or distortion (differential distortion) results in 
unacceptably high rates of failure to verify or recognize an autho- 
rized user — i . e. . high rates of the so-called ^'false rejection" or 
^^type 1 error". Artificial measures aimed at reducing this failure 
rate lead inevitably to the converse: unacceptably high rates of 
JO failure to reject unauthorized users, inpostors — i . e. . high rates 
of the so-called "false acceptance" or '^type 2 error". 

Merely allowing for some distortion, in a statistically uncon- 
trolled way, can never cure this fundamental failing. Skin and flesh 
distortion does not affect prints in an uncorrelated way, but rather 
JS in partially systematic ways that arise from the physical character of 
skin and flesh. I believe that failure to account properly for dis- 
tortion is the single greatest contributor to poor performance of 
fingerprint verifying systems heretofore. 

Furthermore variations in habits of placement of a fingertip on a 
40 sensor tend to be somewhat systematic. These systematic properties of 
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the print-forming process have their own statistically characteristic 
patterns — their own statistics. 

In the context of any given coit^jarison method^ these special 
statistics exert particular characteristic effects on the results. 
5 All the patents mentioned above appear to ignore these statistics, in 
the process discarding very important information that bears strongly 
on verification decisions. 

In addition, the patents listed above fail to make use of modern 
principles of decision theory and signal processing that have been 
to used to great advantage in other fields. Driscoll, for instance, 

while discussing the final stages of his analysis in terms reminiscent 
of the established Neyman-Pierson analysis, does not appear to prop- 
erly apply the principles of that analysis. Such principles have been 
iii5>ortantly applied in industrial, military, and scientific pattem- 
f5 recognition problems, but workers in the practical fingerprint field 
do not appear to be aware of these principles or in any event are not 
evidently using them. 

Similarly none of the patents noted makes use of decisional down- 
weighting of data from areas that are less certain or noisier; rather, 

to to the extent that any consideration at all is given to such matters, 
noisy data are singly discarded — a very undesirable way to treat ex- 
pensive data. Bandpassing of test data is not seen in these referen- 
ces, although certain other forms of filtering are used by Driscoll 
and others. Normalizing is likewise absent except for trivial 

26 forms iir^alicit in binarization or trinarization , used in many print 
analyzers. Hone of the noted patents teaches expression of test and 
template data, or cozcparison of such data with one another, in terms 
of local sinusoids. 



JO Thus the skin-pattern verification field has failed to make good 

use of all available data, take effective account of dilations or 
distortions, make suitable allowance for known statistics of placement 
variation, and apply modem decisional and signal -processing tools. 
As can now be seen, the prior art in this field remains subject to 

36 significant problems, and the efforts outlined above — although 
praiseworthy — have left room for considerable inprovement. 



SUMMARY OF THE DISCLOSURE 

The present invention introduces such in?>rovement , and performs 
40 fingerprint verifications with an outstandingly high accuracy not 



BN8DOC1D: <MO...jB810370A1JL> 




wo 98/10370 PCT/US97/16580 

-5- 

available heretofore. The invent:ion has several facets or aspects 
which are usable independently — although for greatest enjoyment of 
their benefits I prefer to use them together, and although they do 
have several elements in common. The common parts will be described 
5 first. 

In its preferred apparatus embodiments, the present invention is 
apparatus for verifying the identity of a person. It operates by com- 
paring (1) test data representing a two-dimensional test image of that 
person's skin-pattern print with (2) reference data derived from a 

10 two-dimensional reference skin-pattern print image obtained during a 
prior enrollment procedure. Each of the apparatus embodiments in- 
cludes some means for holding instructions for automatic operation of 
the other elements of the apparatus; these instruction-holding means 
include or make use of a nonvolatile memory device, and may be termed 

15 the ^^nonvolatile memory means". 

Now in preferred embodiments of a first of its independent 
aspects, the apparatus includes some means for extracting from the 
test data an estimate of noise variance in the test data. For pur- 

20 poses of breadth and generality in expression of the invention, these 
means will be called simply the ^^extracting means"; they extract a 
noise-variance estimate as a function of position in the test image. 

The apparatus of this first facet of the invention also includes 
some means for comparing portions of the test and reference data, for 

25 corresponding positions in the two images. Once again for generality 
and breadth these means will be called the "con?>aring means". 

In addition the apparatus includes some means for weighting the 
ixrportance of comparison for each portion. These means — again the 
"weighting means" — weight the inportance of conparison for each 

30 portion in accordance with the noise-variance estimate for the corre- 
sponding position. 

Also included are some means, responsive to the weighting means, 
for making an identity-verifi cation decision — identified here as the 
"decision-making means". 

35 The foregoing may be a description or definition of the first 

facet or aspect of the present invention in its broadest or most 
general terms. Even in such general or broad form, however, as can 
now be seen the first aspect of the invention significantly contrib- 
utes to resolving the previously outlined problems of the prior art. 

40 In particular, the use of downweighting for noisier regions of a print 
is a major step toward enabling use of essentially all available data. 
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Now turning to a second of the independent facets or aspects of 
the invention: in preferred embodiments of this second facet, the in- 
vention apparatus includes some means for deriving from the test data 
corresponding multilevel test data that are bandpassed and normalized. 
5 For reasons suggested earlier these means may be denoted the ^Meriving 
means " . 

For the purposes of this document the term "normalize" is to be 
understood as describing a true stretching (or compression) of the 
dynamic range of data to a standard range — while maintaining niulti- 

10 level character of the data. This normalization thus is understood to 
be beyond the trivial forms seen in prior-art binarization and tri- 
narization, which force all data to be only binary or at most trinary. 

This apparatus also has comparing means related to those de- 
scribed above for the first aspect but here the con?>aring means are 

IS for comparing portions of the bandpassed and normalized multilevel 

test data with the reference data. In addition it has decision -making 
means, also related to those described earlier — but here the 
decision-making means are responsive to the comparing means. 

The foregoing may constitute a definition or description of the 

20 second facet or aspect of the present invention in its broadest or 
most general terms. Even in such general or broad form, however, as 
can now be seen the second aspect of the invention resolves the previ- 
ously outlined problems of the prior art. 

In particular such an apparatus by taking advantage of signal- 

26 enhancing techniques of bandpassing and normalization improves both 
actual signal-to-noise relations and effective signal-to-noise rela- 
tions in the system, in terms of best use of the available data- 
handling capability. 

These advantages have not heretofore been enjoyed by skin-pattern 

30 verification systems. In this way this second facet of the invention 
too leads toward greater precision and accuracy in verifying prints. 

In a third of its independent facets, the invention apparatus 
includes means for expressing the test data in the form of local 
35 sinusoids, and means for expressing the reference data in the form of 

local sinusoids. The apparatus also includes comparing means — but 
here the comparing means con^are portions of the sinusoidal ly ex- 
pressed test data with the sinusoidally expressed reference data. 

Decision -making means are also included, responsive to the com- 
40 paring means as just defined. By operating on the data in sinusoidal 
form the invention in preferred embodiments of this third aspect is 
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able to exploit many advanced signal -processing techniques, particu- 
larly including the Fast Fourier Transform (FFT) , multiplicative oper- 
ations in the frequency domain in lieu of convolutions in the spatial 
domain, back- transformations to find spatial results etc. — each of 
5 which saves a great amount of computational time and effort without 
loss of accuracy. Neither sinusoidal representations nor Fourier 
treatment of digital data has heretofore been used in this field. 

Preferred apparatus embodiments of the invention in a fourth of 
to its independent facets include some means for deriving from the refer- 
ence data a map of ridge spacing and direction. These deriving means 
also store the map as one or more vector wavenumber fields. 

Further included are some means for corr5>aring portions of the 
test data with the reference data; these cozi^aring means include means 
IB for using the vector waveniimber fields to refine the coniparing opera- 
tion. The apparatus also includes decision -making means responsive to 
these coniparing means , 

While some earlier systems do make one or another type of ridge 
i^P/ typical earlier uses proceed to direct comparison of the maps. 
20 None stores the map in the form of a vector wavenumber field for later 
use in refining a discrete comparing operation. 

This aspect of the invention enables several extremely effective 
uses of the ridge spacing and direction data in adjustments of the 
authorized-user teirplate for fairer comparison with a candidate user's 
25 fingerprint. Such advantages will be more clearly seen in later 
sections of this document. 

i^paratus of preferred exi^odiments according to a fifth independ- 
ent aspect or facet of the invention includes some means for estimat- 

Ja ing the assumed dilation of the test image relative to a reference 
image — i . e . . ^'dilation-estimating means". The dilation here 
mentioned is to be understood as having a global character — in other 
words, affecting the entire print uniformly, without change of shape. 
The dilation-estimating means thus estimate isomorphic dilation. 

J5 The apparatus also includes means for con^jaring the test data 

with the reference data, taking into account the estimated dilation. 
The apparatus also includes decision -making means that respond to 
these comparing means . 

This facet of the invention too advances the art meaningfully as 

40 it enables two major operating improvements . The first of these is 
finding small regions of a candidate -user print that correspond to 
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select.ed distinctive regions of the authorized-user template even 

in the presence of dilations that would otherwise destroy the correla- 
tion and so izrpair recognition. 

The second major operating iit^rovement attributable to this fifth 
independent aspect of the invention is particul arly efficient opera- 
tion of a more-general distortion-estimating aspect of the invention 
that will be described below. My global-dilation evaluating feature 
gives the later distortion estimator a running start, in that the 
distortion estimator need seek only the spatially differential part of 
the overall distortion — perturbations, in other words, of the 
global, isomorphic dilation. 

Apparatus according to a sixth independent aspect of the inven- 
tion includes some means for estimating an assumed distortion of the 
test image relative to a reference image. Here the distortion under 
discussion particularly includes nsnisomorphic distortion. 

As will be understood, however, the distortion here mentioned 

typically also includes an isomorphic component to the extent that 

previous detection of and accounting for isomorphic dilation was 
imperfect, or perhaps was not provided at all- The apparatus also 
includes means for comparing the test data with the reference data, 
taking into account the estimated distortion; and decision-making 
means responsive to these comparing means . 

Although all the independent aspects and facets of my invention 
make extremely inportant contributions to excellent performance of my 
invention, the distortion-estimating means resolve the root cause of 
what I consider the greatest single defect in prior systems. As 
suggested earlier, it is this defect that especially impairs the 
ability of prior systems to reliably recognize an authorized user — 
i . e . . to recogrnize a clear, clean template which has sitiply been 
slightly distorted. 

In particular the estimation of distortion enables application of 
the estimated distortion to approximately equalize test and reference 
data with respect to the assumed distortion. The conparing means can 
then compare the thus -approximately-equalized test and reference data. 

This can be done particularly straightforwardly, by using the 
estimated distortion to generate a matched filter for use in forming a 
test statistic. In both the filter generation and the actual use of 
the test statistic thereby formed, the system can readily be made to 
take into account estimated noise variance in the test data, as a 
function of position in the test image. 
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The distortion adjustment underlies and enables all such refine- 
ments. The result is an overall level of excellence in recognition of 
teir5)lates, even in the presence of unusual distortions — leading in 
turn to truly extraordinary low error rates of both the "false rejec- 
6 tion" and "false acceptance" types. 

Operating details of the distortion-estimating means — including 
demodulation of the test data, smoothing, downsampling and then a cau- 
tiously expanding gradient search for the assumed distortion field, to 
avoid loss of phase registration — will all be presented below. 

10 

In a seventh of its independent facets or aspects, preferred 
apparatus embodiments of the invention include some means for compar- 
ing the test data with the reference data to form a test statistic as 
the ratio, or logarithm of the ratio, of the likelihoods of two 
IS contrary hypotheses : 

likelihood of obtaining the test image, assuming that the candi- 
date user is the same person who also formed the reference 
fingerprint image (teitplate) , and 

20 

likelihood of obtaining the test image, assximing that a different 
person formed the reference print image. 

This apparatus also includes decision -making means responsive to the 
25 test statistic. 

This aspect of the invention thus for the first time in the fin- 
gerprint field makes proper use of established principles of decision 
theory. Print verifications are thereby placed on a sound footing 
that actually leads to the most conclusive decision that can justifi- 
ably be made from the available information — no more, no less. 

Fingerprint-based identity verifications have long suffered from 
absence of such sound basis. Advantageously my comparison means are 
combined with means for comparing the test statistic with a threshold 
value preselected to impose a desired certainty level in verification. 

35 

In yet another independent facet or aspect of my invention, pre- 
ferred embodiments of the invention take the form of a method, rather 
than apparatus. This method is for verifying the identity of a F>er- 
son. The method does so by comparing test data representing a two- 
40 dimensional test image of that person' s skin-pattern print with refer- 
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ence data derived from a two-dimensional reference skin-pattern print 
image obtained during a prior enrollment procedure. 

The method includes the step of extracting from the test data an 
estimate of noise variance in the test data as a function of position 
5 in the test image. It also includes the step of comparing portions of 
the test and reference data, for corresponding positions in the two 
images . 

Furthermore the method includes the steps of weighting the impor- 
tance of comparison for each portion, in accordance with the noise- 
to variance estimate for the corresponding position; and — responsive to 
the weighting means — making an identity-verification decision. 
Another step is, in nonvolatile memory, holding instructions for 
automatic operation of the foregoing steps. Thus the method partakes 
of the advantageousness of the noise- weigh ting apparatus embodiments 
IS of the first independent aspect of the invention, discussed earlier. 

All of the foreaoino operational principles and advantaaes of the 
present invention will be more fully appreciated upon consideration of 
the following detailed description, with reference to the appended 
20 drawings, of which: 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a flow chart or block diagram showing, for certain 
preferred embodiments of my invention, how different portions of the 
25 programmed firmware perform the processes of the inventions- 
Fig. 2 is a rough conceptual presentation of a windowed subset of 
the authorized-user tenylate, arrayed with sixty- three isomorphs of 
that sxibset — nine rotations and seven dilations (including the 
original) ; 

V> Fig. 3 is a rough conceptual diagram of the original sxibset of 

Fig. 2 in position in the authorized-user template, and one of the 
nine-by-seven array of isomorphs linking that template with the 
candidate data; 

Fig. 4 is a rough conceptual diagram, conveying the general 
JS principle of applying a distortion field to modify the teirplate ; 

Fig. 5 is a highly enlarged conceptual diagram of a whorl area in 
a fingerprint, particularly illustrating changes of interridge phase 
in the area; 

Fig. 6 is a graph or diagram showing relationships of a very 
40 general representative "test statistic"; 
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Fig. 7 is a like view for a test statistic 52 of Fig. 1, in 
accordance with the present invention; and 

Fig. 8 is an overall block diagram showing the embodiment of my 
invention in a hardware system. 



DETAILED DESCRIPTION 

OF THE PREFERRED EMBODIMENTS 

Inputs As Fig. 1 shows ^ preferred embodiments have at least 



10 of a weapon or other apparatus^ another from the authorized user (or 
that person' s surrogates) , and the third from generalized population 
data. The candidate's inputs include a fingerprint -image data array 
11 and a command 57 (at bottom left in the drawing) that the apparatus 
operate. The data array 11 originates from a skin-pattern detector, 

t6 which is most representatively an optical sensor array but may instead 
be of another type such as capacitive, variable-resistive or high-fre- 
quency acoustic. 



TO array 21 (originating analogously to the array 11 for the candidate 
user, discussed above) , and a parameter setting 27 which reflects the 
desired certainty with which a fingerprint match must be found. The 
authorized user does not necessarily personally enter this parameter 
27 into the system, but may instead indicate a selection of the value, 

25 or acquiesce in the value, of this parameter. 

The desired-certainty threshold parameter 27 is related to the 
relative numbers of false positives and false negatives to be toler- 
ated — but not in an arithmetically direct way, rather in complicated 
statistical ways as will be explained in further detail later in this 

30 document. For this reason, a more precisely correct name for this 

threshold parameter 27 might be more abstract, e. a. "decision thresh- 
old'' ; however, the phrase ^Mesi red- certainty threshold" may be more 
helpful as it is more descriptive. 



In particular, it can be related to the probability of false nega- 
tives, so that it could be thought of as controlling the "desired cer- 
tainty" of acceptance for the authorized user . Alternatively, the de- 
sired-certainty threshold can be inversely related to the probability 
of false positives, and thought of as controlling (but in an inverse 
40 way) the desired certainty of rejection for an unauthorized user. 



5 



three groups of inputs: one group of inputs from the candidate user 



The authorized user 's inputs include a fingerprint -image data 



This value is selected to reflect the type of usage anticipated. 
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For exan^le, if the apparatus is to control access to an advance- 
fee-based gYranasium, the primary objective may be merely to discourage 
occasional cheaters. In this case the certainty of acceptance for the 
prepaid customer or member of the gym may be set very high — accept- 
ing a significant chance of letting in someone who has not paid. 

Similarly if the apparatus is a weapon to be used in the field by 
military or police personnel, a primary objective may be to have use 
of the weapon available to the authorized user without delay and 
without question. In this case the certainty level may be set rela- 
tively high accepting some small chance that the weapon might be 

usable by an opponent who takes it from the authorized user. In this 
case, however, since there are significant risks associated with an 
opponent's appropriation of a weapon, the authorized-user acceptance 
likelihood might not be set quite as high as in the first example 
above where the adverse consequences of admitting a cheater are minor. 

Now in a contrary exan^le, for control of access to a secure area 
containing documents or apparatus of utmost sensitivity, a primary 
objective may be to exclude spies. In this case, certainty level for 
acceptance of authorized personnel may be set distinctly low ac- 
cepting some significant likelihood that an authorized individual may 
be delayed in entry by having to repeat the verification procedure. 

Similarly if the apparatus is a weapon to be kept in a home for 
protection against intruders, a primary objective may be to prevent 
unauthorized use by children or teenagers who live or visit in the 

home. In this case the certainty level may be set relatively low 

accepting some small degree of unreliability in the weapon's avail- 
ability for use against intruders — but perhaps not as low as in the 
immediately preceding example, since delayed availability of a weapon 
to an authorized user in an emergency is ordinarily much more onerous 
than delayed entry to a secure area. 

A third type of input is a statistical set 17 preferably coming 
from neither the candidate user nor the authorized user, but rather 
from a generalized database representing p eople in general . Since 
these data are ordinarily derived without reference to the particular 
people known to be involved, I call these data "prior statistics" or 
^^ a priori statistics". 

The statistical data 17 are applied 18, 16" at certain points in 
the processing to take into account the known deqree of variability in 
the way people place their fingers on a fingerprint-acquisition 
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imaging device. This variability may differ depending on the position 
and orientation of the imaging device in relation to the user. 

For exan^le, variability in a panel -mounted imager at an auto- 
matic teller machine may be expected to have a statistical pattern 
5 that is different from variability in a desktop imager in an office. 
Variability in an imager that is built into a tool ( e. . a weapon) 
may be expected to be different still . 

In some cases ^ particularly where a user typically is standing 
while applying a fingertip to a stationarily mounted imaging device, 
to this variability may vary with height of the user. In any event it is 
preferable to collect a different a priori data set using the actual 
imager type and collection geometry for which a particular apparatus 
will be used. In extraordinary cases ^ initial data acquisition may 
show that the authorized user' s prints have very unusual properties or 
IB characteristics; and better performance may result from using a sta- 
tistical set 17 derived from input data 21 for the authorized user. 

Procedural overview A glance at the bold vertical lines 14, 22 

in Fig. 1 reveals the fundaxnental scheme, to direct signals 12-14 from 

20 the candidate fingerprint image data 11, and signals 22-26 represent- 
ing the authorized user's preprocessed fingerprint image data or tem- 
plate" 21, to a common final conparison 51. Side calculations or sig- 
nal paths 15-16, 28-47 along the way facilitate or enhance the result. 
Results 52-56 of the coxiparison 51 interact with signals 59 gen- 

25 erated by the candidate's command 57 — in a manner controlled by the 
desired-certainty threshold 2 7 — to determine whether the command 57 
produces no perceptible action at all (}) , or operation 56. (The in- 
vention encompasses including a no-function warning light or tone, 
rather no perceptible action, if use is denied 55d.) 

30 

Preliminary processing of the candidate' s data — Processing of 
the candidate image data 11 begins with analysis 12 of the dynamic 
range of signals which represent grooves and ridges within the image. 
The result includes forming a new image-data version 13, in which this 

35 dynamic range is normalized, i . e. locally stretched or compressed to 
precisely match the overall range of the later processing stages. 

In addition the new version of the image is siibjected to Fourier 
analysis — expressing the data as spatial sinusoids — and bandpass 
filtering, to eliminate inappropriate spatial frequencies in the image 

40 version 13. In the analysis 12, preferably spatial frequencies are 
treated as "inappropriate" if they are not spatial frequencies 21' 
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that could have originated from the similarly preprocessed print (tem- 
plate) 21 of the authorized user. 

Preprocessing of the authorized user's print to obtain the 
tenplate will be described shortly. In such original preprocessing, 
5 spatial frequencies can be rejected based on a more leisurely 
harmonic-content analysis of the user's print. 

Closely associated with the range analysis 12 and resulting 
bandpassed, normalized sinusoidal data 13 is a downsaix?>ling step 13' 
which greatly reduces the amount of data to be processed in all later 

io stages of the procedure. This step 13' is iniportant : it can make the 
difference between a procedure that is unacceptably time consuming and 
one that is practical. 

Of course it is also important that the procedure be accurate. 
Properly controlled downs anqs ling at this step, however, does not 

IS degrade overall performance. It is known that the data 13 are repre- 
sented sinusoidally , and that these data cannot have major components 
at finer spatial frequencies than the smallest spacing of troughs or 
ridges in the authorized user's print 21. Accordingly, in downsampl- 
ing 13' it suffices to preserve representative values at a reasonable 

20 fraction less than half of that smallest periodicity — or for exainple 
about one third of the average periodicity. Once again the terrplate 
frequency content 21' is useful, in guiding selection of an optimum 
spatial frequency for use in the downsan^ling step 13' . 

2S Phi losophi cal overview Four important characteristics of the 

invention can be gleaned already from the foregoing discussion of 
blocks 12 through 13' in Fig. 1. First, the assumption is made 
throughout that the candidate user is the authorized user — and that 
this assuitption can be confirmed, if only we conduct a fair compari- 

JO son. 

It might be supposed that this assxamption will lead to an 
overwhelming nxunber of false-positive test results. Such a supposi- 
tion would be incorrect, for I have found that a fair comparison will 
only highlight the underlying differences in information content 
35 between an unauthorized candidate (iii5)OStor) and the true authorized 
user . 

The present detailed description, as it unfolds, will make 
progressively more apparent that each intermediate process step 23-47 

of my invention when practiced upon a typical jiyipostor' s print — 

40 is most likely to lead to catastrophic misalignment of the two prints. 
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By far the most likely end result, in the final decision 54, is a 
decisive denial 55d. 

The assun9>tion under discussion is also confirmed from the 
opposite perspective: what happens if the candidate user is in fact 
5 the authorized user? A fair con^arison is absolutely essential to 
eliminating the effects of enormous variation in fingerprint appear- 
ance due to details of operating conditions. Such details include, in 
particular, the physical and emotional condition of the user — and 
these considerations are especially important to avoid rejecting the 
10 authorized user. 

Thus the assuirption that the candidate is the authorized user 
only leads to very great reduction in amount of data to he processed, 
and very great increase in reliability of results. 

*5 A second characteristic of the invention is an overriding plan to 

form respective versions of the two data sets 11 and 21 which are ^ 
adjusted to be as much alike as possible. This adjustment, however, 
is only with respect to certain data properties that are known to be 
variable within multiple trials or instances of essentially any single 

20 user to form a print. 

These particular variable data properties, within their known 
degree of variability, are at best immaterial (and at worst mislead- 
ing) to identification or verification. The invention is accordingly 
fashioned to ferret them out, so that they can be canceled out in a 

25 word, to ignore them. 

In doing so, it is necessary to accommodate the extreme time 
pressure associated with the candidate -data processing. Conversely, 
relatively long times can be devoted to obtaining several instances of 
an authorized user' s print — and selecting the most representative 

30 one(s) of them, and performing image enhancement thereon. It is desi- 
rable to take advantage of the available time to perform such extra 
steps, though it only very occasionally turns out to have been neces- 
sary. 

The shaded lines 58 enclose those portions of the data collection 
3S and processing that can be performed in advance, before deploying the 
apparatus or receiving the candidate user's command. These portions 
include establishment of a statistical set 17 and the desired-cer- 
tainty threshold 27, as well as the authorized-user data collection 
and processing 21 through 22", and 28 through 31' . 
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A third characteristic of the invention is closely related to the 
first two. This characteristic is that the invention makes the 
teirplate as clean and as definite as possible — and then exploits 
that fact by primarily relying upon the teir^jlate, rather than upon the 
5 candidate data, wherever feasible. 

A first example of this is in the preferred use of the template 
to provide periodicity criteria 21' for both the analysis 12 and 
downsairplincf 13' rather than relying upon statistics of the candi- 

date data 11 for the bandpassing criteria. This strategy is preferred 
10 even though the analysis 12 does in fact extract those candidate-data 
statistics 15 for other purposes. 

Later examples of this characteristic of the invention will be 
seen shortly in the preprocessing selection 31 and premassaging of 
numerous local subsets 31' of the template 21. This characteristic 
15 will be seen also in the preprocessing preparation 28 of local ridge- 
spacing maps and vector wavenurober fields 29; and also highly special- 
ized gradient 22' and quadrature forms 22" derived from the template 
21 and wavenumber fields 29. 



20 A fourth characteristic of the invention is that it operates on 

the data in terms of local sine-wave patterns, rather than as isolated 
binary data bits or linear (ridge and groove) structures. Thus the 
initial noise and range analysis 12 operates not only in positional 
space but also in Fourier space (in other words, in terms of the spa- 
rs -cxai r2ro<^oncxos xn cne candxciace iniage) , a.na Tine new vex-sxon ox* rxi- 
tered information 13 is presented as aziq^litudes of sinusoids associ- 
ated with each region of the original image. 

By virtue of this characteristic, while guided by detection 
theory the invention can also take advantage of the high computational 
20 efficiency and fidelity of the Fast Fourier Transform (FFT) . The FFT 
performs a large fraction of the computationally intensive processes 
in the algorithm. 

Preprocessing of an authorized user' s print images During 

J5 preprocessing 58 the authorized user provides a fingerprint that will 
be refined to form a ten?>late 21. Details of the refinement will be 
discussed shortly. 

Where time permits, best results are obtained by acquiring sever- 
al realizations, or successive trial images, of the authorized user's 

40 print and analyzing them to determine which is most representative 

and whether they have any extraordinary character that may require 
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special handling. From the representative authorized-user print image 
or images 21, in preprocessing 58 the system selects 31 several 
distinctive regions^ subsets or windows 31'. These small, preferably 
circular regions 31' are stored separately from the full template 21 
5 — as are (preferably for certain embodiments) numerous versions or 
variants of each region, prepared by applying a variety of crosscombi- 
nations of various-sized rotations and dilations. 

Since this part of the procedure is performed during preprocess- 
ing 58 rather than later during decision -making time, there is great 
10 freedom to calculate the rotations and dilations by any of various 

procedures — such as, e , a , , by oversampling and interpolation. For 
reasons that will appear shortly, however, the regions/variants 31' 
are preferably stored as Fourier transforms, rather than directly as 
spatial data. 

IS Nevertheless it is preferable to calculate these transforms 

expeditiously. Preferably the procedure known as a "Fast Fourier^ 
Transform" (FFT) is used, although this precludes a single-step 
transformation in two dimensions. Two one-dimensional FFTs can be 
calculated more quickly. 

20 Other important data 21' , 29, 22' , 22" are also advantageously 

extracted from the ten^late 21 during preprocessing, making best use 
of the more leisurely time available for this work. Already mentioned 
are the statistics 21' for use in the image noise and range analysis 
12 of the candidate image 11 . 

25 This information is found through data conditioning akin to that 

12 which is discussed elsewhere in this document in relation to 
candidate data. Also found through such data conditioning are normal- 
ized, bandpassed data, and vector gradient fields 22' (somewhat 
closely related to the template data 22) . 

30 In addition, a so-called "matrix covariance estimator" is used to 

map 28 magnitude and direction of local ridge spacings in the ten^late 
21 — to form vector wavenumber fields 29, which will be used later in 
forming the final template 26 for comparison 51 with the candidate 
data 14. During preprocessing 58 these fields 29 also are combined 

35 (not shown) with the input template data 21 in such a way as to 

provide smoothing along ridge lines, in the output template data 22; 
and moreover are also multiplied by the template gradient 22' to form 
two quadrature-phase forms 22" of the teznplate data 22. 

These quadrature forms 22" too will be used in forming the final 

40 teirplate 26 for con?>arison and also particularly in beginning 42 to 

isolate differential distortion 4 5 in the candidate print. During 
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real-time processing, as shown, the two cjuadrature forms 22" and the 
wavenuihber fields 29 will all be modified twice 23, 25 — keeping them 
in step 24' , 29' , 26' , 29" with the modified direct template data 24, 

In addition, flags are set up in certain of the vector wavenximber 
fields 29 to warn of phase reversals in the template data 22, as will 
be explained below. These warning flags are used in selecting one or 
the other of the quadrature phase forms 22", 24' , 26' of the teziplate 
for use . This enables the system to avoid errors that would otherwise 
arise in allowing the processing to continuously traverse phase 
discontinuities . 

Further specifics of these preprocessing steps will be introduced 
below in discussion of the processing stages that make use of these 
sp>ecial preprocessed data. 

Using candidate-data variance estimates The above -discussed 

initial noise analysis 12 in the candidate-data (left) half of Fig. 1 
may be considered roughly as a data colander, which separates data 
from noise. Both the data and the noise are then suitably directed, 
respectively, for beneficial use. 

Fig. 1 shows that the data and the noise actually proceed to many 
of the same later stages of the algorithm, in the sense that the later 
processing blocks 34, 44, 51 receive both data and noise. In each of 
the later processing modules, however, these different pieces of 
information are separately received and very differently used. 

Thus one of the above-mentioned side- calculation paths is appli- 
cation of the noise information 15 abstracted from the candidate data 
to enhance later stages of processing. This information 15 is in the 
form of an array or field of variance estimates, in effect overlaid on 
the reformed image data 13. 

In other words the system constructs and keeps a separate index 
15 of the reliability of the image data 13 in each region of the 
image, respectively. These reliability indices are used to weight the 
respective s i cmi f i cance that is attributed to each comparison or other 
calculation based upon data in the corresponding image regions . 

Thus for instance the noise variance array 15 is applied 16 to 
the final comparison step 51, so that the final test statistic (mea- 
sure of probable identity between candidate and authorized user) 52 
depends more heavily on portions of candidate data 11 that are rela- 
tively cleaner. The test thus depends more lightly on portions that 
are relatively noisier. 
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Such use of dovf n wei ah t ed information, where the information is of 

lesser reliability, is far superior in making maximum use of 

available information — to merely setting an arbitrary criterion of 
reliability and then discarding questionable information. The latter 
6 technique appears, for exairple, in Driscoll's selection of a very 

small number of "best-match" regions, and then proceeding directly to 
final decision based on such regions. 

For any given intensity of calculation, and any given noisiness 
and distribution of noisiness in the candidate data, the downweighting 
10 maximizes the reliability of the results at each point in the proce- 
dure — and overall. For like reasons the noise array 15 is also 
applied 16' , 16" to control certain others of the previously mentioned 
side calculations. 



tS Global search & isomorphic adjustment: purpose Another side 

calculation 31-38 yields a measure of sin^Dle (shape- invariant) geomet- 
rical mismatches in the formation , or realization , of the candidate 
print image 11, relative to the template 21. By the terms "formation" 
and "realization" I mean to distinguish variations in placement of a 

20 fingerprint from the information content of the candidate print 
itself. 

Preferably for certain embodiments this second side calculation 
31-38, like the first, is partially performed in preprocessing time 
58. This side calculation 31-38 accounts for displacements or trans- 

2B lations of the entire image, rotations of the entire image, and also 
dilations or contractions of the entire image resulting from variation 
in pressure with which the entire fingertip is pressed against the 
sensor. As will be understood, when increased pressure squashes the 
whole surface of the fingertip against the receiving surface, the 

30 whole fingertip surface may expand slightly but preserving the 

original shape, i . e . isomorphically . 

Of course the authorized user's initial print is taken with some 
applied pressure, so each candidate-print realization may be made with 
either more or less pressure than applied in making that initial 

J5 print. Hence the size change if characterized as "dilation" may be 
either positive or negative — or, if multiplicative, as a factor 
greater or less than unity. 

The global search is "global" in two senses: first, the entire 
candidate print is canvassed to find one or more regions that most 

40 closely match preidentif ied portions of the teirplate. Second, once 

the one or more best -match regions are found the remaining mismatch is 
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treatied as a positional /dilational error with respect to the entire 
useful area of both prints . 



Identifying comparison regions for global search Coirparison 

6 regions 31, also called "local sxibsets" of the texrplate 21, are first 
Identified 31 (and if desired their data separately stored) during 
preprocessing 58. They are identified 31 as regions that have some 
particularly distinctive character. 

Such distinctiveness may be defined for example in terms of high 
10 rates of change of harmonic content. If preferred, within the scope 
of my invention they may instead be defined in more conventional ways 
such as closely adjacent plural/multiple ridge or groove endings. 

In the preferred embodiment, the choice of subset is made by lo- 
cating a circular subset window in such a way as to minimize the 
IS values of the crosscorrelatxon function of the windowed subset versus 
the entire template image at nonvanishing offset values. Pref- 
erably plural windows are established 31 in this way, each under the 
assunq>tion that any already-established windowed region is unavail- 
able . 

TO In any event it is in^ortant that the selected windows contain 

essentially the most distinctive features of the authorized user's 
print, since they will be used to guide the process of adjusting the 
ten^late to match the candidate. If the features used were instead 
relatively common, the system would be more likely to perform the 

25 adjustment incorrectly even if the candidate is the authorized user 

resulting in a f alse -neaative finding 55d. 

Each of the local subsets selected 31 represents a view of a 
small part of the template, as seen through a small window. The size 
of the window is important: it must be large enough to contain a 

JO moderately complex and therefore truly distinctive set of features; 

but small enough to preserve correlation i . e. , enable recognition 

of its distinctive features when allowance is made for isomorphic 

translations, rotations and dilations, and even if the fingerprint has 
undergone more general locally-varying distortions. Also preferably 

3S the several identified 31 subsets are reasonably well separated from 
each other, or they may not be independent enough to corr^lement each 
other in the ways to be described. 

In later real-time comparison processing, the invention will 
40 search through the downsampled sinusoidal data 14, 14' from the 

candidate user, to find a closest available match for at least one of 
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the siabsets from the authorized user. The way in which the subsets 
are prepared for such a search, during preprocessing 58, strongly 
influences both (1) the data-storage requirements for the system and 
(2) the time which passes while the prospective user is waiting for 
5 the invention to make its decision. 

A tradeoff between these two factors, data storage and real-time 
processing, leads to two major alternative approaches to managing the 
subset preprocessing. At present the limiting consideration is time; 
however, in the future if much higher processing speeds become avail - 
10 able it may become desirable to instead opt for solutions that reduce 
storage at the expense of time. Therefore both approaches will be 
outlined here. 

For mininaxm data storage, it is possible to simply save each 
selected subset in the original form that appears within its respec- 
ts tive small -window portion of the terrplate. In this case, the sxibsets 
shown as rectangles 31' in Fig. 1 may be identified on a one-to-one 
basis with those selected windows, although actually there are likely 
to be only three or four such windows. 



20 one, so that actually it is highly desirable to save each subset 

and indeed the entire data set for an authorized user — in an ab- 
stracted or abbreviated form rather than in its original form. 
Accordingly these options are associated with one major preferred 
embodiment of the invention. 

2S They are important in particular when a compact, self-contained 

system either must stQi;-^ ^py templates, for each one of many ( e. a. , 
a hundred) authorized users, or must read in a teirplate from a remote 

data bank or from an identification card ^ e . q . . with magnetic 

strip or bar code) carried by the user. Either of these cases puts a 
premium on smallness of the data file for each user, since full data 
(and even more emphatically preprocessed full data) are very costly to 
store within the system for multiple users, or to transmit or store on 
an ID card. This first major preferred embodiment is particularly 
applicable in environments where a short additional delay, perhaps a 

J5 half second to a second, for calculations is acceptable automatic 

tellers, office doors, etc. 

In later real-time processing, however, if a subset is presented 
for comparison only in its original form, sifting through the candi- 
date data 14' for a particular subset is relatively unlikely to 

40 succeed. This is true even if the candidate is in fact the authorized 



This minimum-data- storage case is in fact an extremely important 
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user, since there is a fairly strong likelihood that the subset of 
interest has been rotated or dilated, or both. 

Therefore a fair test requires, to begin with, checking each 
region of the candidate data 14' against several rotated forms of the 
5 sxabset under test — rotated through different angles. In addition to 
a nonrotated subset, the preferred embodiment checks eight nonzero 
rotations, ranging from negative (clockwise) through positive angles. 

A fair test also requires checking each such region against sev- 
eral dilated forms of that same subset — dilated by different fac- 
to tors, ranging from values below unity through values above unity. A 
second major preferred embodiment therefore checks, in addition to a 
nondilated sixbset, six nonunity dilations. 

EMrthermore each region of the candidate data 14' should be 
checked against forms of that subset which have been both dilated and 

ts rotated covering most or all crosscombinations of those same 

rotation angles and dilation factors. Taking into account the zero- 
rotation, unity-dilation cases, the second major preferred embodiment 
of the invention preferably uses nine rotations and seven dilations, 
for a total of sixty- three cases to be checked. 

to Each case represents rotation and dilation isomorphically — that 

is to say, without change of shape. Each of the sixty- three variants 
may be termed an ^^isomorph". 

As will be understood, for a representative three subset windows 
this works out to nearly two hundred isomorphs to be checked against 

25 each region of the candidate. During real-time processing all these 
variant forms can be constructed geometrically by the processor, but 
at this writing the additional time occupied in this effort — or the 

additional cost of parallel processors to do this work tends to 

make this approach prohibitive for high-urgency applications such as 

JO weapons or emergency communication systems. 

Preferably instead, for the present, each of typically three sub- 
sets is pre formed (or ^'premassaged") into each of the sixty-three 
isomorphs (Fig. 2) described above, and each of the resulting one 
hundred eighty-nine isomorphs is stored in the apparatus. This 

35 represents the tradeoff that yields minimum processing time but 

maximum storage, and as pointed out just above is associated with a 
second major preferred embodiment; it is particularly appropriate to 
single-user environments < e. a. , personal weapons) where extremely 
rapid verifications are required with very high certainties. 

40 For a clearer conceptual grasp of the mul tiple-isomorph preforma- 

tion technique, an original subset 31 (Fig. 2) may be regarded as at 



BN800CID: <dfVD...J96103rOA1JL> 




wo 98/10370 



PCT/US97/16580 



'23- 



the center of an array of several rotations < shown in the drawing as 
arrayed from left to right in order of increasing counterclockwise 
angular values) and several dilations (shown as arrayed from bottom to 
top in order of increasing dilation) . Rotations are eniphasized in the 
5 illustration by radial tick marks at the four coit^^ass directions of 
the original . 

Negative or clockwise rotations thus appear to left of the 
centrally placed original 31, and dilations by factors less than one 
— or in other words contractions — appear below that central origi- 
10 nal 31 . Pure rotations are in the same row directly to left and right 
of the central original 31, and pure dilations are in the same column 
above and below it. 

Crosscorobinations make up the remainder of the illustration, for 
instance an isomorph 31 'm of maximum negative rotation combined with a 

IS two -thirds -of -maximum positive dilation being shown near upper left. 
Whereas an original sxabset 31' (Fig. 3) is always in the original^ 
relation to its full ten^late 21, in general it will later be found in 
some other relation (if at all) in the candidate data 11. 

Thus the same above- introduced isomorph 31 'm (Fig. 2) — 

20 clockwise-rotated and rather strongly dilated — may appear in a 

different position in the candidate data (Fig. 3) . The association of 
such a structure 31 'm with both the template 21 and candidate data 11 
thus links the two data sets together, and reveals how an isomorph 2 4 
of the entire template 21 must be selected and disposed for a fair 

2S comparison. Just such information 38 is what is sought by the global 
search 32-37. 

As will be clear to those skilled in this field, any of a great 

variety of conpromises may be stx-uck. These may involve merely by 

way of example storing all the rotational variants but constructing 

JO all the dilational variants on the fly, or vice versa; or storing 

certain of the rotational variants and constructing others as pertur- 
bations of stored ones, etc 

Thus a third major preferred embodiment is associated with a 
family of such tradeoffs, one tradeoff in particular involving use of 

35 seven rotations and three dilations for a total of twenty-one iso- 
morphs at each sxibset 31' . Another tradeoff is performing most 
derivations 28, 29, 22', 22", 31 on the fly. 

For the above-mentioned second major preferred embodiment illus- 
trated rectangles 31' in Fig. 1 actually represent a considerably 

40 larger ntimber of stored variants of some three subsets or windows 
selected 31 from the template 21 . This preparation pays off hand- 
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soinely later, in a blindingly efficient search through the candidate 
data 14' for all one hundred eighty-nine isomorphs, constant -shape 
variants . 

For maximum search efficiency it is advantageous to store the 
5 Fourier transforms of the sxabwindows , rather than their direct spatial 
representations. As will be seen, this preference saves time in the 
real -processing stage because the procedure preferably uses the 
transforms . 

Returning briefly to the first major preferred embodiment men- 
10 tioned above: storage of templates in abstracted or abbreviated form 
' level -downsampled to two-bit or binary data) does require care 
to avoid loss of ultimate performance. I have found that such storage 
need not impair accuracy if the data are properly processed after 
retrieval . 

*^ In particular, routine template-data steps of bandpassing, 

normalizing and smoothing should be performed on the abstracted data 
to as nearly as feasible reconstitute the original information set. 
These steps beat down the high frequencies introduced by storage in 
one- or two-bit form, 

M Another critical time for success of such methods is preparation 

for storage. The raw data should be smoothed, downsairpled and normal- 
ized before storage. 



Selection and ste pping of the comparison regions in the global 

25 se^yqh In real-time processing, the first (most distinctive) of the 

subsets or windows 31' is selected for comparison with the filtered 
candidate print 13. In Fig. 1 this function is called ''siobset step- 
per" 32. 

More specifically, the stepper 32 selects a first one of the 
JO sixty- three isomorphs of the first window or siibset 31' . In simple 

spatial terms, it is desired to find a portion, a small region, of the 
candidate print 14' which most closely corresponds to this first 
subset isomorph 31' . 

One straightforward way of finding that most closely correlated 
J5 candidate-print region would be to simply pass the first subset 

isomorph 31' systematically over the whole candidate print. While 
doing this, it would be necessary to keep a record of the quality of 
the match betvreen the isomorph 31' and each portion of the candidate 
print traversed . 

40 For example, the apparatus might first position or superiirpose 

the first subset isomorph or variant 31' in the upper left-hand corner 
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of the candidate print, and maasux*e the similarity (goodness of 
correlation) between the first variant 31' and the superposed candi- 
date region. Then the apparatus would record that correlation value 
in association with the position. Next the first variant 31' might be 
5 shifted to the right by a distance equal to some fraction of the 

typical ridge spacing, and the measurement and recording repeated for 
this new position. When the con^sarison process reached the right-hand 
edge of the candidate, the apparatus would shift the first variant 31' 
down by, again, a distance equal to soma fraction of the typical ridge 
10 spacing, and then again scan across the candidate print while record- 
ing correlation values at each position. This entire sequence would 
be iterated until the comparison had been con^leted for all rows. 

From the recorded data the system could then pick the best 
correlation value, and retrieve the position information associated 
IS with that value. The result would be a specification of both (1) the 
best correlation position for the first subset variant 31' and (2) the 
quality of the correlation there. 

The scanning-and-recording procedure described to this point is 
closely equivalent to the mathematical procedure of convolving the 
20 candidate print with the first variant subwindow. As can be seen from 
the above description it entails a very significant amoxint of process- 
ing time, though it only finds the best correlation for just one of 
the plausible rotations and/or dilations of the first subset. 

2S With the data expressed in sinusoidal terms as previously men- 

tioned, the same output information can be found much more efficiently 
by search for the correlation in Fourier space, as follows. First the 
Fourier transform of the candidate print is multiplied by the Fourier 
transform of the particular rotated, dilated subwindow of the tem- 



The resulting product is bacJc-transf ormed, yielding a real array 

that holds the quality of correlation for each position of interest 

i . e . . for each position in the candidate print, just as if found by 
stepping across and do%m as described above. In this array, location 
36 of the maximum correlation value represents position in the candidate 
print, and the value itself is the quality of correlation at that 
position. 

The output array of the back-transform actually holds data that 
are the equivalent of spatial stepping at intervals equal to the data 
40 spacings — i . e . . in view of the previously mentioned periodicity- 
controlled downsanpling 13' , finer intervals than the ridge spacings. 



30 plate. 
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Thus the procedure yields the best-match position of the subset in the 
candidate, and the quality of the match. 

From a purely mathematical point of view, this two-step process 
might be deemed equivalent to convolving the candidate with the sub- 

5 window but, if so, only in the sense that mathematical proofs are 

available to show the equality of the output ntunbers . In practical 
terms (and patent terms) , to the contrary, the Fourier method is not 
at all equivalent: the process itself is extremely different, and the 
result includes obtaining the desired information in a far shorter 

10 time and with many fewer computer transactions or steps. 

Thus this Fourier process is preferable to direct comparison of 
the spatial data because it is much more efficient. In preparation 
for this process, as mentioned earlier, the numerous siabwindows of the 
template are preferably stored as their Fourier transforms , and the 

IS candidate print too is Fourier transformed — just once, at first 
entry to the location-estimating stage 34. 

For best results some positions in the candidate print — in 
other words, some values in the array — are excluded from consider- 
ation. The apparatus should not be allowed to select regions that are 

20 sxibject to edge effects, in particular, or any other systematic major 
corrupting influence. 

The Fourier- transform procedure itself has alternative versions. 
In particular, for greatest efficiency, rather than a two-dimensional 
Fourier transform the invention can calculate two successive trans- 

25 forms of the so-called "Fast Fourier Transform" (FFT) type, one for 
each of the two dimensions of the candidate print. 

The invention as described to this point thus finds the region 38 
(Figs. 1 and 3) of the candidate print that most closely matches the 

30 first siibset 31' of the template, taking into account an ample range 

of rotations and dilations i . e . , a best-matching isomorph 31' m. 

In the process the invention also finds a measure of the quality 36 of 
that closest match 38. 

If that quality is better than a prees tab li shed threshold, the 

3S invention can be programmed to conclude that the found position, 

orientation and dilation are clear and clean enough for use in the 
following procedural stages. At this early stage, the displacement, 
rotation and dilation thus found are assxomed to have affected the 
entire template equally, i . e . globally. 

40 In other words it is assumed here that the candidate print may 

have resulted from only certain kinds of changes in the teinplate: 
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shift, rota-tion, and overall change of scale isoznorphically (size 
change while holding constant shape ) . The apparatus then proceeds to 
use this information in an isomorphic adjustment 23, which will be 
discussed shortly (and which will be a prelude to the next major side 
S calculation 41-47, 25-26). 

If, however, the quality 36 of the closest match 38 is not better 
than the preestablished acceptable quality, then it is reasonable to 
conclude that either (1) the candidate print was not made by the 
10 authorized user or (2) operating conditions led to some disnxption of 
the authorized user's print, particularly in the area of the first 
subset 31' . This second possibility must be carefully accommodated to 
avoid false negatives — i . e . , rejection of the authorized user. 



IS arbitrarily to cut off analysis, as for example in the Driscoll 

system. Rather, if the candidate print fails the established quality 
criterion here, the apparatus can be made to conclude only that 
perhaps the failure is just a matter of unusable data arising from lo- 
cal disruption of the authorized user's print. In this case the 

20 system is programmed to repeat the stepper process 32, but using 

another subset from the original selection 31 of subsets or windows 

31' in the authorized-user teirplate 21 in effect simply looking for 

usable data elsewhere in the candidate data 14' . 

25 When the invention cannot find an adeqtuate matching position in 

candidate data for any of the sixty- three variants of a first window, 
it resorts to the next most distinctive window or stibset 31' previ- 
ously selected. It looks for a best correlation position of dilated 
and/or rotated forms of that window. 

30 As with the first window, the process checks numerous variants, 

in effect stepping across and down the candidate print with not only 
the second subset but also its isomorphs at each of a series of 
orientation angles cross combined with a series of possible dilations. 
Again from the many resulting correlation measures, the best is 

ss selected. It identifies the candidate region that is a closest match 
to the second window 31' , and at the same establishes a rotation and 
dilation assumed to have affected the entire template. 

Again if this second set of data fails the quality threshold, the 
system can resort to a third, and sometimes (rarely) even a fourth. 

40 If usable data are found with any of these, the system proceed^s to the 
previously mentioned isomorphic adjustment. If not, still other 



The preset threshold of q[uality used here need not operate 
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levels of analysis may be used as fallbacks; however, in testing, my 
invention has been found to operate satisfactorily without resort to 
such fallbacks. In other words, the invention has been found to 
successfully find a usable correlation between some one of the subsets 
5 31' and any input data 14' that represent a real fingertip pattern. 

Although the foregoing paragraphs describe a particularly effi- 
cient and advantageous technique, various strategies may be adopted to 
find the best variant of the best window 31' , and best matching candi- 
10 date-print position. All such strategies, whether using direct 

spatial stepping or Fourier techniques, are within the scope of ray 
invention and so within the sweep of certain of the appended claims. 



As indicated above, if the best match to the first subset is of 
fS marginal or poor quality the selector/ stepper 32 will select another 
subset, and similarly may then select still another. This happens 
most typically if the candidate is an impostor. Thus processing delay 
is least likely to be extended when the candidate is actually the 
authorized user — a collateral benefit of the previously mentioned 
20 operating assxjcctption that the candidate is the authorized user. 

It is possible, however, that the first subset cannot be matched 
to any region of the candidate print even though the candidate is 
authorized. This failure may perhaps be due, for example, to damage, 
unusually severe distortion, abrupt folding <if such folding can 
25 occur) or obscuring of the skin — or a piece of dirt or a stain — in 
that region. 

The above-described iteration of the procedure using a second 
distinctive region 31' is intended to deal with this exigency. Pref- 
erably the stepper 32 selects the subsets 31' in decreasing order of 

zo distinctiveness, and typically the second subset is only somewhat less 
distinctive than the first. Therefore only a slight loss of certainty 
in overall result 54-57 is suffered by resort to the second subset. 

If a candidate is not the authorized user, and only rarely 
otherwise, the stepper may proceed to try a third and successive 

3S subsets 31' . Eventually the best (or most typically for an in^jostor 
the least poor) of the sub set /placement combinations is selected for 
use, and as will be understood the subset in this case is rela- 
tively speaking — not very distinctive. 

If, to the contrary, two or more of the subsets 31' yield com- 

40 parably acceptable (but both rather poor) isomorphs, my invention 
could try to resolve this ambiguity by repeating the procedure for 
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these two subsets. For this situation, however, in principle the two 

stabsets or regions may be treated concurrently, as a unit or, 

alternatively, each of the two subsets may be considered separately, 
but with each siibset or region being enlarged by addition of an 
5 immediately adjacent region. 

Such operation, though well within the scope of the invention 
(and the sweep of certain of the appended claims) , has been found 
unnecessary. The preferred embodiment accordingly includes no such 
hybrid-subset procedure . 

10 

Isolation and use of the best overall match: isomorphic ad- 
justment — Eventually the stepper 32 settles on a subset-and-isomorph 
combination 31 'm, 38 ( i . e . . combination of subset with location, 
orientation and dilation ) of a single or enlarged composxte region 
t5 that yields the best quality-of -match index 36. At this point the 

focus shifts from selection of the subset-and-isomorph pair to use of 
the isomorph alone. 

Thus the iterative procedure 32-37 produces an output that is the 
isomorph 38 from the best siibset- isomorph combination. Again, this 
20 isomorph 38 represents the shift, angling and expansion of the tem- 
plate 21 which make the tenplate best match the candidate 11 in the 
vicinity of the selected subset of tezrplate data. 

As will be seen, there is a possibility that it is only in this 
vicinity that the template best matches the candidate. In fact, a 
25 particularly advantageous aspect of the present invention is an 
ability — as will be fully explained below — to deal with this 
possibility. At this stage, however, this best-match information is 
all that has been assembled. 

Therefore this best-estimated position/angle/scale combination 38 

ZO is applied 23 as a correction to the template signal 22 forming an 

adjusted template 24 ( cf . Figs. 1 and 3) that is more fairly com- 
parable with the filtered candidate data 13. In short, following the 
global search 32-38 is an isomorphic adjustment 23. 

In the isomorphic adjustment, as the name conveys, no change of 
35 shape occurs — but the entire template signal 22 ( i . e . . the ten^late 
throughout all of its regions) is shifted, cocked, and dilated or 
contracted, to form an isomorph 24 of the entire template 21 . that 
matches as nearly as possible the corresponding features 38 of the 
candidate print as found in the selected window 31' . Again, while it 
40 might be supposed that it would be reasoncJole to adjust or perturb the 
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filtered candidate data 13, 14, the philosophy of the invention is to 
modify 23 the template data 22 preparatory to the comparison. 

Reasoning behind this philosophy may now be better appreciated: 
the template is relatively cleaner and clearer, and these properties 
are reasonably well retained in its adjusted form 24. Adjustments to 
the candidate data 13, 14 would interact with its relative noisiness, 
and statistically speaking through second-order effects disturb the 
likelihood of a match. 

The total area imaged in the candidate print 11 cannot be closely 
controlled to match the template 21. Moreover the template is shif- 
ted, angled and dilated: when the two data fields 14, 26 are eventu- 
ally overlaid for comparison some areas of each field will fall 
outside the other, and so be unusable. 

As in all print-analysis systems, comparison will then proceed on 
the basis of the remaining areas, those areas which coincide , or in 
other words what may be called the ''usable" or ''overlapping" data 124 
(Fig. 3) . In the conceptual illustration, the coarse hatching is only 
intended to help identify the overlap region 124, not to suggest 
fingerprint ridges or the like — which of course are much finer. 

In the Driscoll and Denyer patents, very small data excerpts from 
teii^>late and saxaple are used in proceeding directly to a final deci- 
sion. In the present invention, by contrast, similarly small amounts 
of template data 31' preferably are used, in the global search and 

isomorphic adjustment, in a very different way namely only to 

obtain an intermediate result. That result is a "once-adjusted" 
tenplate 2 4 which is more fairly comparable with the candidate image 
data 11-14. 

of the overlapping data in this adjusted template 24, which 
is to say essentially all the overlapping data in the original tem- 
plate 21, will eventually be used. Furthermore, all these data will 
be used in comparison with essentially all of the overlapping data 14 

from the candidate i . e . . excepting only the data points removed 

13' as redundant . 

Demodulation, gradient search for distortion, and dis tortion 

adjustment: purpose The isomorphic correction 23 adjusts the 

entire tenplate based upon relative placement in just one small 
region. Therefore, even if the candidate is in fact the authorized 
user, there still exists a crucially inqportant potential for mismatch 
between the adjusted template 24 and candidate data 14. That poten- 
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tial resides in the possibility of twisting or other deformation in 
the candidate . 

In other words, the candidate user's finger may have been applied 
to the sensor surface in such a way as to distort the overall pattern. 
5 Such distortion consists of differential offsets, rotations and 
dilations internal to the pattern. 

No single isomorphic adjustment can possibly take account of such 
internal differential effects. It is believed that internal distor- 
tion may be most to blame for failure to reliably verify presence of 
10 an authorized user — false negatives — in even the most highly so- 
phisticated of prior-art systems. 

Again Driscoll seeks to deal with these phenomena by allowing 
for, and seeking, small movements of a secondary and/or tertiary 

IS window relative to expected position. The system of Driscoll appar- 
ently is limited to such displacements that can be interpreted as part 
of an overall rotation of the print. 

Driscoll does use a least-squares fit to find the best position 
for an overall -rotated version of his template, to use in comparison. 

20 Such a fitting technique may perhaps iii^jlicitly permit other kinds of 

movements isomorphic dilation or differential distortions- A 

least-squares fit, however, would be appropriate if departures from 
positions corresponding to an isomorphic rotation were merely random" 
error in the larger sense of lacking correlations, lacking even soft 

25 constraints. 

The present invention proceeds on the basis of a xmich more 
complete statistical model than Driscoll' s methodology implies. The 
present invention automatically applies a kind of relatively low 
credence, on a sliding scale, to information that has a relatively 

30 high degree of inconsistency — but without entirely discarding such 
information . 

Although some uncorrelated measurement error may be present, 
there is no basis for assuming that the entire amount of departures 
from predicted positions are without mutual correlation. Different 

J5 portions of fingertips are not understood to undergo relative dis- 
placements that are uncorrelated. 

To the contrary, different portions of fingertips are understood 
to be physically interconnected by skin and flesh, interrelated 
through their interactions with skeletal members, and otherwise 

40 coordinated s ystematically . Furthermore the use of a least-squares 
fit, being divergent from the reality of skin-pattern internal rela- 
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tlonships^ cannot provide meaningful guidance for eltiher assessing or 
limiting the character or magnitude of relative movements other than 
those found through Isomorphic rotation. 

The Denyer patent too speaks In very general terms of maJclng 
allowance for such movements. It offers little or no guidance as to 
how such allowance might be made. 

What both these prior systems fall to provide Is any systematic 
or principled theoretical basis, for constraining the amount of 

allowance'' for these movements that Is permitted. This falling Is 
crucial^ for Inadequate '^allowance" will result In turning away an 
authorized user, but given enough unfettered ^^allowance" almost any 
print will match almost any other. 

Of course some experience may be brought to bear in making an 
educated guess about amounts of rotation or twisting that seem plausi- 
ble, and amounts that seem too permissive and thus too likely to grant 
access to iirpostors . The measurement space in which such prior-art 
guesses must be made, however, appears very ad hoc or addressed to a 
particular physical immediacy — essentially a form of designing at 
the drill press. 

The proper extent of such ^"allowance" is therefore not readily 
amenable to quantification or to statistical analysis, and this 
fundamental limitation aggravates the previously noted limitation of 
making final decisions based on a small fraction of the available 
information. As will be seen the present invention, by contrast, is 
able to relate the amount of solidly expected variation — through 
direct application 18, 18' of the a priori statistics 17 — to the 
measurement preparations 44 and final-decision preparations 52. 

The assessment and use of this some times -so -called ^^prior por- 
tion" 17 of the expected signal statistics advantageously tend to 
favor smoothness in the distortion field as estimated. The prior 
statistics rest on an implicit assxamption that the distortion field 
contains some correlation structure some physically based interre- 
lationship between what happens in one part of the field and what 
happens in another. 

As noted above, different portions of the skin pattern are, after 
all, physically interconnected — each part pulls on each other part 
(and that "other part" pulls back) . The prior statistics thus quan- 
tify the degree to which individual displacements (which in the 
aggregate constitute the distortion field) are correlated with each 
other. Preferably a Fourier-space model is used for the prior-portion 
statistics 17. 
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With some of the hardest work done in the global search 32-38 and 
isomorphic adjustment 23, my invention is now able to very efficiently 
isolate 42-47 and adjust 25 ^ cf . Figs. 1 and 4) the ten5)late for 
distortion. In a very rough conceptualization, this is accoii?>lished 
5 by applying 25 (Fig. 4) the distortion field 45 to the once- ad justed 
ten^late 24, to obtain a distortion-corrected ten^late field 26. 

The distortion field 45 (Fig. 4) also is roughly conceptualized 
as a field of displacements 45a, for exanple moving fixed vertical 
grid lines 45" (symbolizing the structure of the frame of reference 
10 itself, i. e. the web of the skin as distinguished from its pattern of 
ridges and troughs) to left or right so that the grid lines 45" assume 
new forms 45b. Arrowheads 45a representing the individual displace- 
ments are in many portions of the drawing very short, and so can be 
seen as only very small arrowhead tips. 

The distortion field 45, 45a has been drawn very sin^lified: 
there are no displacements of the horizontal grid lines 45' . The 
drawing does show, however, that on balance the overall amount of 
leftward and rightward shifting is about equal — as it should be, 
since any isomorphic dilation or contraction should have already been 
20 incorporated into the isomorphic adjustment 23 which formed the first- 
adjusted template 24. 

The symbol "K" in Fig. 4 is not to be misinterpreted literally as 
an actual multiplication: though some coniplex multiplication is 
involved, that would be an overs in?>lificat ion ; rather the symbolism of 
2S multiplication is only intended at a rough conceptual -analogue level 
to represent application of a distortion field 45. The distortion- 
corrected field 26 will later be used as a matched filter in the final 
comparison 51. To extract 42-44 the distortion 45 and so prepare the 
data for this Qfinisomorphic adjustment 25, I first treat the distor- 
30 tion 45 as if it were a data signal inpressed upon a carrier wave — 
in other words, as if the distortion were a relatively slowly-vairying 
information signal modulatin g a carrier. 

The carrier in this situation is the relatively higher-spatial- 
frequency ridge/groove pattern of the natural fingerprint, with the 
36 finger at rest or undisturbed by differential stresses. Two clarifi- 
cations are needed: 

First, it must be recognized that in the final analysis, liter- 
aily the final analysis 51-56, what is of interest is the ridge/groove 
pattern rather than the distortion. The focus upon the distortion at 
40 this point is only temporary and only for purposes of isolating and 
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then canceling it — just as the global search isolated placement /di- 
lation so that it could be globally (but isomorphically) canceled. 

Second, not only the distortion but also the "instantaneous 
carrier" (local harmonic content of the ridge/groove pattern) varies 
5 strongly from place to place within the candidate image 13. Hence it 
must be understood that distortion will necessarily be extracted as a 
vector field , varying over the image area, not a single global parame- 
ter and not even a scalar field — and the ^"carrier" too must be 
treated as a field with many strong local variations. 

10 

Obtaining a ^^carrier^^ for use in demodulation — Fortunately it 
is unnecessary to determine what this varying carrier field is, in a 
candidate image 13. Instead the authorized-user template 21 is taken 
to be the carrier for the candidate data. 

IS Properties or characteristics of the template 21 needed to 

implement this approach can be found in advance, during preprocessing 
58. Part of this is done by in effect mapping 28 the local ridge 
spacings and orientations, and saving the resulting magnitudes and 
directions as vector wavenvimber fields 29. 

20 Here too the assuxrption that the candidate is the authorized user 

is put to major advantage: the tenqplate 21 is assumed to be the car- 
rier of a distortion field, a vector field, in the candidate 11, 13. 
The vector waveniimber fields 29 of the template represent the spatial 
frequencies of that carrier. 

25 Once again, if the candidate is not the authorized user, these 

latter assumptions fundamentally become gibberish and the ensuing 
correlation most commonly fails dramatically. 

Demodulation of the distortion field My invention next pro- 

30 ceeds to actually estimate directly, in three steps 42-44, the entire 
distortion field 45. The first step 42 is demodulation to obtain an 
intermediate result, namely a complex field whose phase is sensitive 
to an assumed vector distortion field. 

For this purpose, forms 41, 41' of the teit^jlate 21 are needed 
35 that contain information about both the ridge locations (with their 
spacings) and their orientations. Stated first singly, multiplying 
the tenplate form(s) 41, 41' and candidate data 14" together yields 
the desired intermediate field 45. 

The original ten¥>late 21 (as well as the once-adjusted template 
40 24) taken by itself is passed 41 to the demodulation process 42, but 
lacks phase data that are needed for such a procedure. Therefore I 
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begxn by constructing somewhat synthetic forms 41" of the ten^late 
that include phase information. 

More specifically, the tenqplate 21 (carrier) is first expressed 
in a modified form, which is obtained through multiplication of its 
5 spatial gradient field 22' by its own vector wavenumber field 29: 



This preliminary product represents a scalar 22" that is in cruadrature 
10 with the ten?>late. 

By the phrase "in quadrature" I mean 90* out of phase, or using 
radian angular measure Tt/2 out of phase. In other words the scalar 
22" found by this multiplication process is everywhere in the pattern 
inherently one quarter of a spatial wavelength offset from the basic 
IS template. The denominator normalizes the expression; thus the quadra- 
ture form differs only as to phase, not as to amplitude. 

It is known that a quadrature form of a periodic positional 
signal, used in conjunction with the basic positional signal itself, 
can yield directional or phase information for use by automatic 
20 apparatus in determining, for example, a direction of motion. In my 
invention a like underlying principle is used, albeit in a conceptu- 
ally very remote context, to enable the algorithm to keep track of the 
direction in which features of the candidate print are offset from 
features of the tenplate. 
^5 If not for the reentrant character of most skin patterns of 

interest, it would be sufficient to use a quadrature form 22" of the 
tenplate in just one single version. The typical closed patterns 62 
(Fig. 2) and whorls familiar in fingerprints, however, render such a 
simple representation inadequate for the following reasons. 
JO In a generally linear region 61 of a print, of course if one 

could monitor, along a path very generally from ridge 75 to ridge 75' , 
it would be natural to expect continuity of phase-gradient direction 

65, 65' i . e. , the direction locally perpendicular to each ridge-. 

line, in which phase increases . By the phrase " continuity of phase- 
J5 gradient direction" here is meant the property of the direction being 
consistent, or in other words not reversing (except perhaps where it 
is near zero) . 

Such continuity as illustrated by phase-direction arrows 65, 65' 
near the left end of the drawing, is expected irrespective of the fact 
40 that two adjacent, parallel ridges 75, 75' happen to open up into a 
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whorl 62, and as shown even a whorl which includes distinctly closed 
loops . 

The phase-gradient directions 65, 65' for both such adjacent par- 
allel ridges 75, 75' — which happen to span such an enlargement 66 

5 can be traced toward the right along the respective ridges 75, 75' . 

Eventually a point 72 is reached at which the "two" ridges 75, 75' are 
found to have been actually different tails of just one common ridge 
75-75' . 

At some such place along the way, therefore, the initially common 

10 phase-gradient directions 65, 65' are found to be directed oppositely 
68, 68' . If this phenomenon is not somehow controlled, the entire 
phase field becomes unmanageably ambiguous as can be seen by tracing 
the upward-pointing phase arrows 65 around the loop. 

Such tracing finds likewise upward-pointing arrows 67 across the 

IS top of the whorl 62 , rightward pointing arrows 68 along the right end 
64 of the pattern, and downward-pointing arrows 69 back across the 
bottom to the left end 61. Even in this latter region 61 of generally 
parall el and rectilinear ridges 75, 75' the downward arrows 69 are 
oppositely directed from not only the upper set of phase arrows 65 

20 above the division line 66 but also the lower set 65' . That lower 

set, as will be recalled, is associated with the identical ridge line 
75' below the division line. 

To deal with such potentially troublesome discontinuities, my 
invention forms not just one but at least two cjuadrature forms 22" of 

25 the previously discussed gradient- times -wavenumber product which is 

a scalar. Furthermore in operation the algorithm of my invention must 
automatically select a particular one of the plural quadrature forms 
for use. 

Preferred embodiments of my invention make this selection based 
20 upon monitoring for phase discontinuities of the sort illustrated. 
The monitoring is preferably carried out by detection of sudden 
reversals in sign of the waventimber field 29. 

These sign reversals can be found during preprocessing 58, and - 
their locations marked by warning flags 73, 74 a specified distance 
J5 from each discontinuity 72 in each direction along an axis trans- 
verse to the discontinuity. Preferably this work is done during 
preprocessing, in formation of the template, moving one step at a time 
in either the x or y direction, in real space — while requiring 
neighboring values to be substantially continuous, and setting up the 
40 flagging in an associated wavenumber field 29. In terms of the Fig. 2 
exan^le, continuous processing along a vertical (y) direction locates 
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the discontinuity 71 at a height 72 in the pattern. Later in actual 
candidate processing, with the wavenumber field downsaii^led 43 onto 
the coarsest grid, the system watches for the flags 73, 74 only at 
right angles to the direction y selected previously for in^josition of 
5 continuity. This strategy enables the processing to stay some dis- 
tance away from a discontinuity. 

For computational convenience I express the template 21 as a 
complex number, I set the real part of this number eq[ual to the 
direct spatial form of the template 21, 22, and the imaginary part 
10 equal to the selected one of the preliminary products, the in-quadra- 
ture scalars 22", just described, i . e. : 

template" = template + i- ( quadrature form of template ) , 

15 where i. is the base of imaginai-y numbers, the square root of negative 
one . 

Both the real 22 and imaginary 22" parts of this variable are 
then siibjected in real processing time to the isomorphic adjustment 
23. The adjusted results 24, 24' are passed 41, 41', as already 

20 suggested, to the demodulation process 42. 

Here the complex variable template ' as mentioned above is multi- 
plied by the candidate data 14", yielding a new complex variable in 
which is embedded phase information related to the distortion field 
that is being sought. The distortion field in fact is fundamentally a 

25 phase-displacement field, though in some minority of cases the phase \ 
shifts due to distortion exceed a half-wave (180**, or TT radians) and 
even a whole wave (360**, or 271 radians) . 

The cases in which maximum distortion thus exceeds half of a 
ridge spacing, although ordinarily in the distinct minority, are by no 

SO means negligible. To the contrary they are extremely important in 

successful practice of my invention. I have found experimentally that 
if such cases are neglected the resulting ambiguity of displacement 
direction — and gross errors in implied character of the candidate 
print — are often catastrophic to recognition of the authorized user. 

SS The new complex variable resulting from this demodulation (multi- 

plication) step may be represented so: 

exp { i • ( distortion f ield > - ( wavenumber field ) } + noise, 
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in which ''exp" means the exponential function, and ^'distortion field^' 
is the unknown random field 45 quantified statistically by the a 
prj,PrA data 17, 

The factor '' wavenumber field "^ represents the same known vector 
6 wavenxuhber field 29' used earlier in constructing the quadrat.ure form 
of the template. The additive term designated "noisg" corresponds to 
the residual effects of all features of the candidate data that do not 
represent the local sinusoid associated with the ridges and troughs of 
the candidate user's skin pattern. The immediate object of the in- 
to quiry is to determine the distortion field. As can be seen, the 
noise " term obscures the desired answer. 

If one wishes to find the true answer it is very desirable to at 
least make some allowance for the full expression, including the 
"noise" term, presented just previously since that full expression 

IS is the quantity which has been found through the demodulation process. 
The preferred embodiment does makes allowance for the measurement 
noise by downweighting the demodulation local ly^ in general proportion 
to local noisiness in the data — or, in other words, by discounting 
information from regions known to be noisy. 

20 Of courses it would be much easier, in a manner of speaking , to 

sinply use a "fitted" phase without regard to any distortion field or 

wavenumber field that is to say, a phase which appears to accoxint 

for observed mismatches between ten^jlate and candidate, but is not too 
large . Doing so, however, would be in a sense somewhat analogous to 

25 the '"allowing" of some plausible amount of translational wandering or 
rotation in the Driscoll method discussed earlier. It would be very 
hard to say, based upon any reasoning from first principles, how to 
constrain such a fitting, or in other words just what "not too large" 
means. This is analogous to the problem noted earlier, relative to 

30 the Driscoll system, of establishing how much translation or rotation 
is plausible and how much is simply letting in more candidate users. 

One of the particular benefits of the present invention is that 
it enables estimation of an actual distortion field that is consistent 
with (1) the assumption that the candidate user is the authorized 

J6 user, and (2) a term "' noise " that corresponds to measurement noise in 
the candidate data, and (3) an additional noise term representing a 
magnitude and degree of smoothness, in the distortion, which is not 
only plausible and not only "not too large" but actually statistically 
likely as quantified in relation to the a priori statistics. 

40 Thus by approaching the phase-field or distortion-field determi- 

nation from this seemingly roundabout direction the present invention 
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places the relevant relationships in a form that is amenable to direct 
use af known variabilities in fingerprint placement. The entire veri- 
fication process is thereby placed on a footing which is far more 
solid and physically meaningful than ever possible heretofore. 
s It remains, however, to say how the distribution field can be 

extracted from the expression presented above. This is by no means a 
trivial exercise, as it calls for, in effect, inverting a matrix which 
is multidimensional — more specifically, having as many dimensions as 
there are downsampled 43 data points to be used. 

10 

Downsamplinq for t ^^gt-a hie processing — Thus extraction of the 
distortion field involves extremely intensive processing. If it were 
necessary to perform such procedures at full resolution, which is to 
say on the entire received data set 14" after the first downsanpling 
IS 13' , the required processing time would be prohibitive in most routine 
uses. With present-day limitations of processing speed it can. only be 
rendered feasible through a two-part "smoothing and second downsam* 
pling" stage 43. Of the two parts of this stage 43, the one that may 
be regarded as the more fundamental is the second downs amp ling, to 

20 reduce by an additional large factor the amount of data to be thus 
intensively processed. 

The earlier downsan7>ling 13' was justified on the basis that the 
data was represented in periodic terms, and that use of sair^ling . 
intervals much smaller than the smallest period represented in the ^. 

25 template could only produce redundant data. Like reasoning applies to 
the distortion field, but the latter is assumed to change far more 
slowly — an order of magnitude more slowly — than the elevation 
changes corresponding to the basic ridge-and-groove pattern. 

Fortunately the desired distortion field as a practical matter is 

JO almost always a relatively smooth pattern. It is most typically a 
differential dilation — such as may be expected from pressing some 
parts of a fingertip more forcefully than others. 

In some cases it may also, or instead, partake of a relatively 
gentle twisting, such as a "C" or sometimes "S" curve — and much more 

J5 rarely with an abrupt near-discontinuity, such as mentioned above in 
connection with the need to resort to second or third local subsets 
31' in the global search. 

Consequently a much smaller amount of candidate data, sampled 
systematically from the filtered candidate data 14, 14" after demodu- 

40 lation 42 suffices to define the distortion field. Thus it is again 
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reasonable to eliminate merely red\andant data by downsaxcpling 43 to a 
much longer sanpling interval than used in the first downsaxnpling 13' . 

In the vex^ occasional case of a considerably more abrupt form of 
5 distortion, just mentioned, the distortion is so abrupt that it can be 
treated as an entirely different case — a near-discontinuity, e. a. a 
very severe local distortion of the skin in a particular region. 

As indicated previously, however, my invention can deal success- 
fully with such cases. It first avoids them in selection of template 
10 sxibsets 31' for the global search; and it later successfully matches 
other very large areas of the print, in the final comparison 51. 

This is a major advantage of the use of essentially all available 
data, data drawn from an entire print as mentioned earlier rath- 
er than only isolated regions. Earlier systems, even relatively so- 
ts phisticated ones such as Driscoll's and Denyer's, typically are q[uite 
unable to verify an authorized user when one or more of the most 
distinctive regions happen to be disturbed in this way. 

In this second downsan^ling it is permissible either to down- 
20 sample from the first downsampled data 14 as illustrated, or to down- 
sanple from the fuller data set 13. The former, however, will be much 
faster. In choosing the second downsampling interval, care should be 
taken to avoid inadvertently, irrplicitly limiting the degree and 

character e. a. » abruptness — of distortion taken to be present. 

25 Arbitrary limitation without physical basis can skew the results. 

Limits on distortion should arise from the model in use spe- 
cifically, by downsampling at sampling intervals which are related to 
a measure of the local rate of relative change of phase in the data. 
This measure conveniently should correspond to the highest significant 
JO spatial frequencies in typical or representative distortion fields for 
real cases . 

Such information is contained in the statistical a priprj. data 
17. Therefore, to obtain such a measure, the preferred embodiment 
first extracts from the a priori statistics 17 an estimate 18" of the 
35 power spectral density for distortion fields general Iv (in other 

words, not fro-n the candidate data 11 or tenplate 21) . It then sets 
the sampling intervals, as a function of position, in accordance with 
that estimate 18" of power spectral density. 

Bandpassing was used in preparation for the first downsampling 
40 13' — not only for control of noise as such but also specifically to 
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avoid downsampling to nonrepx-esentative data points. Similarly it is 
desirable to smooth the data before the downsan^ling procedure. 

This smoothing is the other, and perhaps the less fundamental, of 
the two parts of the '^smoothing and downsairpling" stage 43 mentioned 
5 above. In the preferred embodiment it is in7>leroented as a low-pass 

(Fourier) filter realized with Fast Fourier Transforms. Preferably 

the smoothing is done as a convolution — with a fixed window in 
Fourier space — in close conjunction with the second downsan^>ling. 



Estimation of the di stortion field: gradient search — My inven- 
tion here uses once again an approach that depends upon manipulation 
of the overall pattern. Here the pattern is considered as a matrix, 
and the best-fit distortion field is sought by an iterative approach. 
This approach in effect tests the improvement in fit found by initial- 
1S ly assuming a distortion field, sequentially making many small changes 
in that field — at each point assessing the results in terms of qual- 
ity of fit — and then redirecting subsequent changes accordingly. At 
each point the ass\an»d field is modified in a direction which the pro- 
cessing results up to that point suggest will further improve the fit. 
20 This iterative approach is somewhat akin to finding the summit of 

a hill by probing at each point for an uphill slope, and then follow- 
ing it uphill a short distance to the next test point. In fact the 
gradient of a quality-of-f i t function is used in this process. The 
"gradient search" 44 used in my invention, however, is mul tidimension- 
75 al - In other words the "hill" is asstimed to be a peak in quality-of- 
fit space, and this space has a number of "dimensions" equal to the 
number of data points in use — in other words, even after the down- 
sampling described above, typically some thousands of dimensions . 
In the progressive approach to finding the best fit, it is 
30 crucial to avoid taking individual steps that are too large. Apart 
from the relatively straightforward hazard of overshooting the peak 
(which can be correctable in later steps if thev are not too large) , a 
much more insidious kind of error arises from excessively long steps. 
As mentioned earlier, many realizations of skin patterns are 
ZS subject to distortions which amount, locally, to more than a half 
wavelength or even one or more full wavelengths in the pattern. If 
such a distortion is allowed to develop too rapidly, the only portion 
of it which is in effect ^^visible" is the fractional part remaining 
after deduction of an integral number of wavelengths . 
40 It is essential to realize that correlation goes to zero in any 

region of the template that is misaligned by only a quarter of a 
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waveleng^h. Hence, avoiding errors of a half wavelength, or of course 
anything larger than that, is of extremely great importance to suc- 
cessful practice of my invention at least in those cases where 

sizable distortions are in fact present. 
5 Scaling of the steps to avoid falling into such ambiguities is 

best achieved by limiting the algorithm' s propagation rate in the spa- 
tial or frecjuency domain, preferably both, outward from the initially 
small region of close match ensured by the global search 32-37. Thus 
search 44 for an estimation of the distortion field begins in a tight- 

10 ly defined region about a distinctive point in the template and is al- 
lowed to expand slowly stepwise. Permissible expansion rate depends 
on ability to extrapolate judiciously from previous distortions. 
Preferably the expansion or extrapolation steps are related to inter- 
vals previously established for use in the second downsazi^ling 43. 

IB Computational burdens in the gradient search are borne by Fast 

Fourier Transforms, which are very efficient. The procedure continues 
until the window has expanded to the whole field. 

Isolation and use of the distortion field — The iterations of 
20 the gradient search 4 4 lead to definition of an estimated distortion 
field 45. This field 45 next is subjected to an intermediate upsam- 
pling step 46, through interpolation — preparatory to use in a dis- 
tortional or nonisomorphic adjustment 25. This distortional adjust- 
ment 25 will form a twice-adjusted tenplate 26, which should provide 
2S the fairest possible final comparison 51 with the candidate data 14. 

The intermediate upsanpling step 46 is needed because the distor- 
tion field 45 was developed on a very coarse grid due to the second 
downsaiipling 43, but the twice-adjusted template 26 must be available 
full resolution. It is needed at generally the same sampling as 
JD established on the candidate-data side in the first downsampling 13' . 

Accordingly, what is read out to the distortion-adjustment step 
25 is an upsairpled version 47 of the field 45; it is this upsampled 
version 47 which is applied 25 to the once-adjusted template 24. The 
application 25 step is done by multiplying together the two complex- 
es valued fields template ' 24 and exp {i ( distortion field ) • ( wavenumber 
field)}, and retaining only the real part of the result. 

The resulting twice-adjusted template 26 should provide the best 

possible likelihood of a match with the candidate data 14 if the 

candidate is in fact the authorized user. If not, then as suggested 
40 earlier the greatest likelihood is that the twice-adjusted template 26 
will bear little relation to the candidate data 14. 
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^%X\^X goniparison, thre sholding and decision — The twice-adjusted 
teirplate 26 and the once-downsazi^led candidate data 14 are then com- 
pared 51. This is done by multiplying them together and summing over 
5 the image, sxabject to inverse weighting 16 based on the candidate- 
image noise variance estimates 15. In this process the twice -ad justed 
teit?>late 26, with the associated twice -adjusted quadrature forms 26' 
and twice-adjusted wavenumber field 29" , constitute and are used as a 
matched filter. The result of the filter process 51 is used to form a 
10 major part of the test statistic 52. 

The latter is preferably formed according to the Neyman-Pierson 
analysis as a y^tAo of the likelihoods of occurrence of the processed 
candidate print data according to two contrary hypotheses — namely, 
that the authorized user (1) was and (2) was not the maker of the can- 
ts didate print. Based on this "likelihood-ratio" procedure, the above- 
mentioned test statistic 52 also incorporates noise statistics 18, 
once again providing an opportunity to ground the results in solid re- 
ality by applying the a priori statistics 17 for the distortion field. 
(As a practical matter, for easier management of ratios spanning 
20 a very large tange of values I prefer to enploy the logarithm of the 
ratio. This variant is sometimes called a "^log-likelihood-ratio", 
method, in turn familiarly abbreviated to "log-likelihood" method.) 

As explained earlier, these data are " a priori '^ in the sense of 
not being derived from either the candidate print or the author ized- 
25 user template. They are not, however, " a priori " in the sense of 

being derived from first principles; rather, these data are collected 
eiDpirically. (In particular there appears no indication that Driscoll 
takes into account any such considerations as the a priori term.) 

One particularly beneficial property of the Neyman-Pierson ap- 
30 proach is that assessment of the two above-mentioned contrary likeli- 
hoods is straightforward. These correspond rather directly to the 
probabilities of false negatives and false positives, respectively. 

In a representative Neyman-Pierson diagram, not particularly 
associated with the present invention, a con^^osite test statistic I 
J5 (Fig. 6) represents a log-likelihood parameter such as mentioned 

above. The two generally bell-shaped curves 81, 82 at left and right 
represent the probabilities of two mutually inconsistent hypotheses. 

To relate this graph to the general field of fingerprint verifi- 
cation, for exanple, the curves 81, 82 might represent the probabili- 
40 ties that a particular print was formed by, respectively, an inpostor 
and the authorized user. A diagram of this sort depends strongly on 
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many different experimental facts, particularly including the amount 
of noise or experimental error in the system. 

The vertical line near the intersection of the two curves repre- 
sents selection of a particular threshold value of the test statis- 
5 tic I. The shaded area 83 extending left ward from that line, under 
the left end or tail of the right-hand curve 82, represents the prob- 
ability of a false rejection of the authorized user — or in other 
words, as it is sometimes called, a "type 1" error. 

The shaded area 84 extending right ward from that same vertical 

iO line Ty, under the right end or tail of the left-hand curve 81, repre- 
sents the acctmiulated probability of an erroneous acceptance of an im- 
postor a false acceptance, or a "type 2" error. As will be appar- 
ent, the relative sizes of these two types of errors can be adjusted 
by sliding the threshold or discriminator T^ to left or right. 

iS This very general diagram is characteristic of a great many kinds 

of processes, and as can be seen the two areas 83, 84 representing 
erroneous decisions each are here arbitrarily drawn as amounting to a 
few percent, perhaps as many as eight or ten percent, of the respec- 
tive overall areas 85, 86 under the two curves 81, 82. That general 

20 range of numbers appears to be representative of, or perhaps better 
than, the state of the art in automatic fingerprint verification 
apparatus and methods heretofore. 

My invention enables both evaluation and quantitative control of 
these two kinds of undesirable result 83, 84 quite readily. As a re- 

25 suit of preliminary work — with expectably some further iirprovement 

yet to be made the overlap region 83' + 84' (Fig. 7) between the 

two probability distributions 81' , 82' is reduced to a small fraction 
of one percent. 

In relation to the present invention, the test statistic T can 
30 now be identified with the like-entitled block 52 in Fig. 1 (see at 
right in Fig, 7) , and the selected threshold T^ similarly identified 
with the threshold 53 of Fig. 1 (see at center in Fig. 7) . As will be 
recalled, the desired -certainty threshold 27 is set during preprocess- 
ing 58 to accord with the authorized user's preferences as to type of 
35 error least acceptable, and cjuantitatively that user's preferred rela- 
tive balance or tradeoff between magnitudes of the two error types. 

Improvement due to my invention is so great that it would be dif- 
ficult to drav.* the two entire curves 81' , 82' at such a scale that the 
overlap regions 83' , 84' could be clearly seen in the Scune view (as 
40 the corresponding much larger regions 83, 84 are seen in Fig. 6) , 
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Characteristic error probabilities 83' , 84' with my invention as de- 
veloped at this writing are very roughly 0.001, or one-tenth percent. 

At worst , with the test statistic threshold 1,. set at an optinaun 
point within the overlap region either the false-negative or false- 
5 positive rate may be a maximum of that same fraction of one percent. 
If the test statistic is offset from that optimum point, however, 
then the particular kind of error of greatest concern to the autho- 
rized user can be made much smaller than that fraction of a percent. 

For instance, the threshold can be set well above the absolute 
10 optimum point, in response to a decision by the authorized user to 
favor false negatives 83' (as for example to give particularly high 
protection against inqproper use by family members) . The probability 
of a false positive 84' is thereby easily made a much smaller fraction 
of one percent, for exan^le 0.01 percent, at the cost of, say, a one- 
rs percent incidence of false negatives 83' . 

TWlmost as important as the low value of the false- negative and 
false-positive probabilities at their crossover point is the fact that 
this crossover probability can be specified . In fact probability of a 
false positive for any particular setting of the threshold 53 can be 
20 quantitatively specified, as can the associated probability of a false 
negative. Given such information, correlated with the range of set- 
tings of the threshold 53, the authorized user is for the first time 
able to make a fully informed and so at least potentially intelligent 
choice of the desired threshold 27. Although the relationship between 
25 selected threshold 27 and actual probabilities, or actual level of 
desired certainty, is not direct in the sense of a linear or simple 
mathematical function, that relationship is both monotonic and readily 
stated in terms of a calibration scale or a tabulation. 

30 Utilization In op>eration a candidate user' s finger or toe 90 

— or palm, or any other surface having a comparable skin pattern 

is applied to the sensitive surface 91 of a sensor module 92 (Fig. 8) . 
The system may be programmed to start when a skin pattern is thus 
applied 57 (see Fig. 1, bottom left) to the sensitive surface, or if 

35 desired may be provided with a separate start-up switch (not shown) . 

The sensor module 92 develops an electronic image 11 (see also 
Fig. 1) . That unit 92 advantageously may be an optical detector array 

— e. Q. . one of the types described in the patent docximents mentioned 
earlier — or any other type that yields a suitable candidate-user im- 

40 age data set 11, for instance a capacitive, variable-resistance, or 
ultrasonic detector. I prefer to use an optical-fiber prism as de- 
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scribed in those docuznent-s . In view of the current economics of large 
sensors and optical -fiber tapers I currently prefer to use a relay 
lens (rather than a taper) to focus the image from the output end of 
that prism onto a small sensor. 
5 Associated with the sensor module is a read-only memory or ROM 

(or a programmable RC»d, EPR^) 93, which holds the authorized user's 
template 21, 22 (Fig* 1) and associated data 22", 29 — as well as the 
desired-certainty threshold 27 and the a priori statistics 17. (In 
Fig. 8 these several callouts are abbreviated "^21 6c.") 
to The candidate data 11, template data 21, and related data sets 

all flow to a programmed or programmable microprocessor or "central 
processing unit" (CPU) 94. Stored in the ROM 93 or in the CPU 94, or 
partly in each, is the program described in this patent document. 

The portions 91-94 of the apparatus discussed so far — and cer- 
ts tain other portions if desired — are advantageously made self-con- 
tained and for certain applications also made portable. Accordingly a 
battery or other portable power supply 95 may be included with the 
sensor module 92 , ROM 93 and CPU 94 , and interconnections incorpora- 
ted, all within a housing 96. In such a case the output enablement 
20 signal 55e (also see Fig. 1) might be the only output from the appara- 
tus. That output passes to access -control module 97, which may 
include a suitable local or remote switching device for passing an 
actuation signal 98 to utilization means 99. 

The utilization means 99 represent a facility, apparatus, means 
25 for providing a financial service, and/or means for providing or re- 
ceiving information. Merely by way of exainple, and without any intent 
to limit types of devices which can be controlled this way, utiliza- 
tion means may be and/or may include a cabinet, home, office, military 
or other government installation, educational institution, weapon, 
ZO computer, vehicle ignition and/or entry, automatic teller, credit 

system, time -and-at tendance system, or database information service. 

As shown the self-contained unit 96 may provide an enablement or 
decisional signal 55e to a discrete access-control unit 97 . In many • 
systems, however, the access-control module 97 is preferably integra- 
ls ted into the self-contained unit 96 — in accordance with security- 
enhancing integration principles described in the aforementioned 
document of Bowker and Lubard. Similarly the whole of the print- 
verifying and access -control devices 96, 97 is advantageously inte- 
grated into the utilization means 99. 
40 In both cases an object of such integration is to make security 

aspects of print-verifying control relatively invulnerable to bypass- 
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ing. That is to say, integration of the whole system can provide 
resistance to insertion of a jxon^er, short, or other form of injected 
simulated access-control signal 98 at the utilization-zneans 99 input. 
Thus for instance in a weapon , bidirectional information flow 
5 between the CPU 94 and a detonator 99 within each projectile (bullet 
etc.) can prevent tampering with the intermediate firing mechanism. 
In a vehicle that has a distributor or other ignition module 94 
directly associated with the combustion system, automatic exchange of 
information between the CPU 94 and that ignition module can de^er 
10 bypassing of the security system. 

In a credit, time-and -at tendance, or information-dispensing 
database-access system, similarly, the CPU 94 should be programmed to 
participate in a dialog with the central computer 94 of the credit 
etc. system. Such a dialog ideally is conditioned to verify not only 
IS the identity of the user but also the integrity of the connection 
between the CPU 94 and the central system. 

In view of the foregoing, further examples will now occur to 
those skilled in the art. 

20 It will be understood that the foregoing disclosure is intended 

to be merely exemplary, and not to limit the scope of the invention — 
which is to be determined by reference to the appended claims. 
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1. Apparatus for verifying the identity of a person by coiqparing 
test data representing a two-dimensional test image of that person' s 
skin-pattern print with reference data derived from a two-dimensional 
reference skin-pattern print image obtained during a prior enrollment 

5 procedure, said apparatus comprising: 

means for extracting from the test data an estimate of noise 
variance in the test data as a function of position in the test image; 

means for cox^paring portions of the test and reference data, for 
corresponding positions in the two images; 
JO means for weighting the iitportance of comparison for each por- 

tion, in accordance with the noise-variance estimate for the corre- 
sponding position; and 

means, responsive to the weighting means, for making an identity- 
verification decision. 

2. Apparatus for verifying the identity of a person by comparing 
test data representing a two-dimensional test image of that person' s 
skin-pattern print with reference data derived from a two-dimensional 
reference skin-pattern print image obtained during a prior enrollment 

5 procedure, said apparatus coir^rising: 

means for deriving from the test data corresponding multilevel 
test data that are bandpassed and normalized; 

means for comparing portions of the bandpassed and normalized 
multilevel test data with the reference data; and 
iO means, responsive to the comparing means, for making an identity 

verification decision. 

3. The apparatus of claim 2, further comprising: 

means for preparing the reference data for storage or export, 
said preparing means con^rising: 

means for at least downsarapling and normalizing the reference 
5 data, and then expressing the thus -prepared reference data in two- or 
one-bit form before storage or eaqport. 
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The apparatus of claim 3, further comprising: 



means for extracting the reference data from storage or from an 
imported data set for use in verification, said extracting means 
con^rising: 

5 means for bandpassing, normalizing and smoothing the stored or 

imported data before use in verification. 

5. Apparatus for verifying the identity of a person by comparing 
test data representing a two-dimensional test image of that person's 
skin-pattern print with reference data derived from a two-dimensional 
reference skin-pattern print image obtained during a prior enrollment 

5 procedure, said apparatus conprising: 

means for expressing the test data in the form of local 
sinusoids ; 

means for expressing the reference data in the form of local 
sinusoids; 

^0 means for comparing portions of the sinusoidally expressed test 

data with the sinusoidally expressed reference data; and 

means, responsive to the comparing means, for making an identity- 
verification decision. 

6. The apparatus of claim 5, further con7>rising: 

means for deriving from the reference data a map of ridge spacing 
and direction, and for storing the map as one or more vector wave- 
number fields ; and 
5 wherein the con^aring means conprise means for using the vector 

wavenumber fields to refine said comparing; and 

means, responsive to the comparing means, for making an identity- 
verification decision. 
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7. Apparatus for verifying the identity of a person by con5>aring 
test data representing a two-dimensional test image of that person' s 
skin-pattern print with reference data derived from a two-dimensional 
reference skin-pattern print image obtained during a prior enrollment 

5 procedure^ said apparatus comprising: 

means for deriving from the reference data a map of ridge spacing 
and direction, and for storing the map as one or more vector wavenxim- 
ber fields; 

means for comparing portions of the test data with the reference 
10 data, said con^aring means comprising means for using the vector 
wavenumber fields to refine said con^aring; and 

means, responsive to the con^aring means, for making an identity- 
verification decision. 

8. Apparatus for verifying the identity of a person by con^aring 
test data representing a two-dimensional test image of that person' s 
skin-pattern print with reference data derived from one or more two- 
dimensional reference skin-pattern print images obtained during a 

6 prior enrollment procedure; said apparatus being for use in the 
presence of an assxamed dilation of the test image relative to the 
reference image; said apparatus comprising: 

means for estimating the assumed dilation of the test image 
relative to a reference image; 
10 means for comparing the test data with the reference data, taking 

into account the estimated dilation; and 

means, responsive to the comparing means, for making an identity- 
verification decision. 

9 . The apparatus of claim 8 : 

further con^irising means for extracting from the reference data a 
subset thereof; and 

wherein the estimating means comprise means for trial -matching 
5 the svxbset of the reference data with successive portions of the test 
data, to find a portion of the test data that best fits the reference 
data subset. 
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10. The apparatus of claim 9: 

wherein the estimating means further conprise means for taking 
possible dilation into acco\int in gauging the test data portions 
against the reference -data subset, to determine relative dilation; 
6 further con5>rising means for applying the determined dilation to 

roughly equalize the test and reference data with respect to the 
assvuned dilation; and 

wherein the comparing means compare the test and reference data 
after said rough equalization. 

11. The apparatus of claim 8, wherein: 

the extracting means coit^arise means for extracting from the 
reference data plural s\ibsets thereof; and 

the estimating means comprise means for trial -matching each of 
5 plural subsets of the reference data with successive portions of the 
test data. 

12. The apparatus of any of claims 1 through 11, further comprising: 
sensor means for acquiring such test data; and 

means, responsive to the decision-making means, for operating a 
switch. 

13. The apparatus of claim 8, particularly for use in controlling 
access to utilization means consisting of facilities, equipment, a 
financial service, or a source or reception of information; said 
apparatus being in further combination with: 

s means for receiving said test data from a sensor that acquires 

surface-relief data from a relieved surface such as a finger; 

means, responsive to the decision-making means, for applying the 
identity-verification decision to control access to such utilization 
means . 
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14. A secured system incorporating the apparatus of claim 13 and 
subject to access control based upon surface-relief data from a re- 
lieved surface such as a finger; said system comprising: 

utilization means, susceptible to misuse in the absence of a 
s particular such relieved surface that is related to an authorized 

user, said utilization means being selected from the group consisting 
of: 

a facility, 
apparatus , 

io means for providing a financial service, and 

means for providing or receiving information. 



15. Apparatus for verifying the identity of a person by con5>aring 
test data representing a two-dimensional test image of that person' s 
skin*pattem print with reference data derived from a two-dimensional 
reference skin-pattern print image obtained during a prior enrollment 

5 procedure; said apparatus being for use in the presence of an assumed 
distortion of the test image relative to the reference image; and said 
apparatus comprising: 

means for estimating the assximed distortion of the test image 
relative to a reference image; 
10 means for con^aring the test data with the reference data, talcing 

into account the estimated distortion; and 

means responsive to the comparing means for making an identity- 
verification decision. 

16. The apparatus of claim 15: 

further comprising means for applying the estimated distortion to 
approximately equalize the test and reference data with respect to the 
assumed distortion; and 
5 wherein the comparing means con^are the thus -approximately- 

equalized test and reference data. 

17. The apparatus of claim 16, wherein: 

the applying and comparing means comprise means for using the 
estimated distortion to generate a matched filter for use in forming a 
test statistic. 
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18. The apparatus of claim 15: 

further coitprising means for extracting from the test data an 
estimate of noise variance in the test data as a function of position 
in the test image; and 
5 wherein the estimating means and the con^saring means perform 

said estimating and said comparing, respectively, as a fxinction of 
position; 

wherein the estimating means or the con^aring means, or both, 
comprise means for taking into account the estimated noise variance. 

19. The apparatus of claim 18, wherein the taking-into-account means 
comprise : 

means for weighting the importance of the estimating or con^ar- 
ing, or both, as a function of position in accordance with the noise- 
5 variance estimate for the corresponding position. 

20. The apparatus of claim 15, wherein: 

the estimating means conprise means for using a maximum- likeli- 
hood method to estimate the distortion field. 

21. The apparatus of claim 20, wherein: 

said estimating means further comprise means for using the 
maxiimim-likelihood-estimated distortion field to generate a matched 
filter for use in forming a test statistic. 

22. The apparatus of claim 20, wherein: 

said using means comprise means for taking account of a priori 
statistics in estimating the distortion field. 

23. The apparatus of claim 22, wherein: 

said using means comprise means for using a Fourier-space model 
for taking account of the a priori statistics. 

24. The apparatus of claim 15, wherein: 

the estimating means comprise means for demodulating the test 
data preliminary to extracting a distortion field therefrom. 
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25. The apparatus of" claim 22, wherein: 

the estimating means comprise means for applying information 
developed from the reference data as a carrier field, in demodulating 
the test data. 

26. The apparatus of claim 15, wherein the estimating means coxnprise: 
the estimating means comprise means for avoiding errors due to 

phase shifts greater than half the local periodicity of the assumed 
carrier field. 

27. The apparatus of claim 26, wherein: 

the estimating means con^rise means for beginning the estimating 
with a first approximation that is localized and of small magnitude, 
and iterating so that progressive approximations propagate in the 

5 frequency or spatial domain, or both; and 

the avoiding means coivprise means for controlling rate of propa- 
gation to minimize likelihood of introducing a phase shift greater 
than half the local periodicity in any single iteration. 

28. The apparatus of claim 27, wherein the controlling means 
comprise : 

means for monitoring a measure of the rate at which the distor- 
tion is changing; and 

6 means, responsive to the monitoring means, for limiting the rate 
of propagation as a function of position, in accordance with said 
measure . 

29. The apparatus of claim 15, wherein the estimating means coirprise: 
means for providing an assumed carrier field for use in demodu- 
lating the test data; 

means for analyzing the demodulated test data to approximately 
5 ascertain distortion associated with the demodulated test data. 

30. The apparatus of claim 15, wherein: 

the estimating means comprise means for downsampling the test 
data according to anticipated degree of abruptness of at least one 
type of distortion, in preparation for estimating the distortion. 
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31, The apparatus of claim 30, further comprising: 

means for extracting from prior statistics an estimate of the 
power spectral density for distortion fields generally; and 

means for setting san^ling intervals as a function of position, 
5 in accordance with the estimate of power spectral density. 

32 . The apparatus of claim 30 : 

wherein the estimating means comprise means for downsampling the 
test data before estimating the distortions- 
further conprising means for applying the estimated distortion to 
5 approximately equalize the test and reference data with respect to the 
assumed distortions- 
further comprising means for interpolating the estimated distor- 
tion, to upsanple the estimated distortion for use in the applying 
means ; and 

0 wherein the comparing means con^are the thus -approximately- 

equalized test and reference data. 

33. The apparatus of claim 15, wherein: 

the estimating means comprise means for using a gradient search 
to estimate the distortion. 

34. The apparatus of claim 15, wherein the estimating means conprise: 
means for first estimating an isomorphic dilation; and 

means for estimating a residual nonisomorphic distortion that 
remains after allowing for said estimated isomorphic dilation. 
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35. Apparatus for verifying the identity of a person by comparing 
test data representing a two-dimensional test image of that p^erson' s 
slcin-pattern print with reference data derived from a two-dimensional 
reference skin-pattern print image obtained during a prior enrollment 

5 procedure, said apparatus conprising: 

means for connparing the test data with the reference data to form 
a test statistic as the ratio, or logarithm of the ratio, of: 

likelihood of obtaining the test image, assuming that said 
10 person also formed the reference fingerprint image, 

and 

likelihood of obtaining the test image, assuming that a 
different person formed the reference fingerprint 
f5 image ; and 

means, responsive to the test statistic, for making an identity- 
verification decision. 

36. The apparatus of claim 35, wherein: 

the deci si on -making means con^rise means for comparing the test 
statistic with a threshold value preselected to impose a desired level 
of certainty in verification. 

37. A method for verifying the identity of a person by comparing test 
data representing a two-dimensional test image of that person' s skin- 
pattern print with reference data derived from a two-dimensional 
reference skin-pattern print image obtained during a prior enrollment 

$ procedure, said method comprising the steps of: 

extracting from the test data an estimate of noise variance in 
the test data as a function of position in the test image; 

con^aring portions of the test and reference data, for corre- 
sponding positions in the two images; 
10 weighting the in^sortance of comparison for each portion, in 

accordance with the noise- variance estimate for the corresponding 
position ; and 

responsive to the weighting means, making an identity- verifica- 
tion decision. 



BNSOOaD: ^^_^B81037QA1JL> 



wo 98/10370 ^ / g PCT/US97/1 6580 



11 



fjfCERFmr 



image nohe Sc range anaJfysts 



15 



INFOR' 

mm 

about the 

NOISE 
(variance 
estimaies) 



I 



FILTERED INFORMTION 
about the 
CANDIDATE PRINT 
( dynamic "range-normalized, 
bandposssed dataj 

"J- 





i y global search 



14 



34 



^estimating hcaiion, orientatmt 
diiaUon of candidate print 



SEST-ESimiED 
POSOTION, ANCLE & SCALE 
of CAMUD/UE PRINT 




fuefkninary 
INFORUAUON 
about 
OUAUTY 
HATCH 
for subset 
under test 




applying posibon/ande/scaie IS 
template <fr its guamture 
to match candidate 

23 



ONCE-ADJUSTED TEMPLATE. 
ITS OtMimiVRE FORMS 
& VECTOR WA\€NUU9ER FIELDS 



2r 




FIG. 



57 



CANDIDATE USER'S 
UTIUIATION COMMAND 




DECISION ON 
UTIUIATION 
denied £ \ enabled 

\55c 



55e S6^ 

OPOjATION] 



SUBSTITUTE SHEET (RULE 26) 



BNnOCtD: .dWO_»1037M1JL^ 




SUBSTITUTE SHEET (RULE 26) 



BN80OCID: <MO__«ei<»raA1_lj> 



wo 98/10370 



3/6 



PCT/US97/16580 




SUBSTITUTE SHEET (RULE 26) 



BNeOOCIO: <MID__f»103rM1JL> 



wo 98/10370 PCT/US97/16580 

4/6 




SUBSTITUTE SHEET (RULE 26) 



BreOOCID: ^ND__M1037QA1JL» 



wo 98/10370 



PCTAUS97/16580 




BNGOOCtD: <WO_pai037QA1JL> 



wo 98/10370 PCT/US97/16580 

6/6 




SUBSTITUTE SHEET (RULE 26) 



BN80OCID: ■dWO_jBei037M1JL> 



INTERNATIONAL SEARCH REPORT 



No. 



PCT/US07/16SSO 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(6) :C06K 9/00, 9/40 

US CL :382/124. 125. 209. 254. 275. 278. 280 
Aceording to IntenitioBal PrntoU c»«»«ift"'>i~a (IPC) or to both 



BXioaal chMilirtwn and IPC 



B. FIELDS SEARCHED 



MiniinuiB doowaieautioa aMiched (cUiMficatioa •yAcn roUo«Md by "i^—ir.-^ aynbofa) 

U.S. : 382/124. 125. 209, 254. 275. 278. 280. US. 116. 126. 127. 206. 207. 218. 256. 257. 260. 274. 279. 280 



Documenutioo ■cwchcd other than minimum rfrw>iim«it.Hnn «« th> ,,t^ ti..^ ,,,^1, Aw. ^ff w.» ^, .„ t^ ly^ in thr ftrHt trirr hr rf 



Elertionic dau hue oouulled dtiriog the iiitera.tiaMi u»rcb (auac of dau hue and. who* pnc(icaUe. MMch toma lued) 
APS, MAYA. IEEE DATABASE 

■eaich tenna: futgerprint. ooite. ridge f pacing and (Urectioa. dilatioo. dirtortioa, le 



C, DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Cilatiaa of Aw i imfwl , with indinatioo. wtm* 



. of Iha loiowaM 



No. 



US 4,811,414 A (FISHBINE et al) 07 March 1989, abstract, col. 3 
lines 13-55, col. 16, line 46 - col. 19, line 54. 

US 5,040,223 A (KAMIYA et al) 13 August 1991, abstract, figures 
5 and 8, col. 6, lines 59 - 68. 

US 5.351,304 A (YAMAMOTO) 27 September 1994, abstract 
figure 1 : 1-2, 1-3 & 1-4. 

US 3,959,884 A (JORDAN et al) 01 June 1976, abstract, figures 17 
&20. * 

US 5,067,162 A (DRISCOLL, Jr. et al) 19 November 1991. 
abstract, col. 4, lines 16-26. 



1, 12, 37 
1, 12, 37 

2-4, 12 

2-4, 12 

2-4, 12 



Further docn i mmu are Uated ia the offniiniiiiinn of Box C. See p**^ Umdy 



to b« oT pvtJuter n2nl 



I ^ AM to 1 



M«nt wtkMh mmy tknm ri onb^ «« pnontjr elM(»> or «h 
to •^■ M iB h ih* piiWi—rWwi oT mathm ^miim or 
ip«URl w ow (m i|MoirMd) 



dooun«al of ^mtM» 
■■Hiiliiiri Mwol or «MoC W OB— irtirid to nvoK* m ■ 

WkBB Ao J«B «H i 



nn ^ h i— d wkk om or ator* odw suofa (km— «oCb. rneh 
okvio— to • pmoB BkdM ia dw «t 



prior to lb* iDtaraolaoa*! fUiaf dau bul lalar I 



to— bir of dto mm* piii ii f—ily 



Dale of the acUiai oompktaoo of the ittt^^^tt^nni acaich 
19 JANUARY 1998 



Date of maiiang of the intemaiionai search report 

I 1 FEB m 



Name and mailing addrea* of the ISA/US 
ComminioMT of Pateau and Tradcnuuki 

Box per 

WMhmgiog. D.C 30231 
Pacaimile No. (703) 305-3230 



Autho^ize^o|0^a^j^^ 

B^VE^i MEHTA / \j/ 
Telephone No. (703) 30a-5246 



Ponn PCT/ISA/210 (secood aheel)(July 1992)* 



BNBOOCtD: <WO_pei037W1JL> 



INTERNATIONAL SEARCH REPORT 



PCT/US97/16S80 



C (CmOiumUmi). documents CONSIDERED TO BB RELEVANT 



Category* 



Ciutioa of dfKMimmt, with tadacjUioQ, whore appropMtc, of the lekcvaoi pamy 



Rekvam to cUioa No. 



Y. p 



X, p 
X, P 

X 
A 
A 
A 



US 4,983,036 A (FROELICH) 08 Januaiy 1991. abstract, figure 4. 
col. 6. lines 23-33. 

US 5,530,772 A (STOREY) 25 June 1996, abstract, figures 1-2, 
col. 2. lines 33-47. 

US 5,619,596 A (IWAKI et al) 08 April 1997, abstract. Figures 1- 
2. 

US 4.208.651 A (MCMAHON) 17 June 1980. abstract, col. 5, 
lines 54 - col. 7, lines SO. especially col 6, lines 27-31. 

US 5.659,626 A (ORT et al) 19 August 1997, abstract, figures 6-9. 

US 5.555,314 A (NAKAJIMA) 10 September 1996, abstract, 
figures 1-2. 

US 4.641,350 A (BUNN) 03 February 1987. abstract, col. 6. lines 
34-67. col. 8, lines 3-46. 



US 5.105.467 A (KIM et al) 14 April 1992, abstract. 

US 4.956,870 A (HARA) 11 September 1990, abstract, figures 1-3. 



5-6, 12 

5- 6, 12 
4-6. 12 

6- 7. 12 

7. 12 
8-14 

15-16 



17-34 

35-36 
35-36 



Form PCT/ISA/210 (conlinuatioa of Moond ■heetKJuly 1992)* 



8N80OCI0: <WO_|W1037IM1JL> 



INTERNATIONAL SEARCH REPORT 



No. 



PCTAJS97/i65S0 



Box I OWrvAtiou wb«r« tmrUim dalw w«ra fMod aaM«r«h«bU (CaBdaMlkM •T IU« i first Ammi) 



This intcmatioQAl repoit hu not beea ftahU i ho d m temped, of cotoia gIamim uoikr Artkie n(2Ma) ibr the lolkyM^ 
I. rn CUioMNot.: 

becaute they rekte Co tubjeoi auttcr noc required to be aem nh od by Chk Auiborky, oaaciy: 



^""^ bec4UAe they reUte to p^iU of the intrxnitinnii appUcatxMi that do ooc oocnply with Ihe p««»oribod 
aa exteot that do meuuugAil utteniAtiooAl search can be carried out, apeetlkaUy: 



to Mich 



□ 



Ihey are 



«Mth«hei 



iorRufe6.4<a). 



Boi II ObMrratioos wb»r« unity oi invantton la lacking (CootinualiaM af llaa 2 af fitat ahaa<) 



Tim IntenutMoal Searching Authority found multiple inveotiont in thia inrmnrional appiicatioa, aa follow: 
Pleaae See Extra SheeL 



1- I X| As ail required a drt i tinn a l ■carcfa fcca were timely paid by the mpplicmjit thim iwo^^ ^i^x^i "-p^f* all '^^ r'-l^b k 



Aa all ■earchable daima could be searched wtthoui effort justifying aa addiltnnal fee, this Authority did noC nvitc payment 
of any artditinntl Cee. 

3- n Aa only some of the required additional search feca were timely paid by the *ppUc^, thi^ f^^^rrh report coycti 

oaly those claims for which fees were paid, specifically claima Noa.: 



No required additional search fees were timely paid by the applicant. Consequently, this international 
restricted to the invention first mentioned in the claims; it is covered by claims Nos. : 



search report if 



Remark on Protast 



l~l The additional search fees were accompanied by the applicant's protest. 
No protcat accompanied the payment of additional search feea. 



Form PCT/ISA/210 (continuation of fint shcct(l))(iuly 1992)^ 



BNSOCX^ <WO_9ei037QA1JL> 



INTERNATIONAL SEARCH REPORT 



No. 



PCT/US97/16S80 



BOX II. OBSERVATIONS WHERE UNITY OF INVENTION WAS LACKING 
Thk ISA found ""■HtpiT' ioveotiiMMi mm Iblkyws: 

TUfl ■pp l irrtkin ooouicw Um foUowing kiveotioiM or imps of lnvMHiiim MMk fmatmt lUed m to tonm ■ mfle 
ittv«nlMaoacc|<ttBderPCTRiife 13.1. In trHirr fnr ail MimrtioM fn hr mmmknd thm ■fynwitii aitiiiliii— I wish 
loos auit be pMd. 

Groi4» I, oLuai(B) 1, 37 and 12. dfmwn to an appantut and method for veffiiyiog an kkniitx of a pmon by extraotinc aa 
ntf i m a tw of aoiae vmriaaoe io the teat data. 

Group lU Gtaiin(a) 2-4 and 12» drawn to an apparatua for verifymg an kkolky of a poaon by deriving muhilevel teat 
dau that ate banc^Maaed and aonnalazed. 

Gfoyp 1U« eUiai(a) 5-6 and I2» dfmiMB to apparmlua for verifying an adesthy of a peraon by expmatftg teat dato and 
reforanoe data in the form of local aaouaotda. 

Gfoup IV. elaiiB(a) 7 and 12. drawn to appaiatiu for verifying an identity of a penon by derivmg tgom the lefcmoe 
<lata a map of ridge spacing and dircotioo. 

Group V. claim(a) S-14. drawn to apparatus for verifying an identity of a person by the "rinr-t1 dilatkia of 

the tast imacB lelative to a raforanoe ioaage. 

Qnup VI. alaia(a) 15-34. drawn to appniatua foa- verifying sn ids^ of a poraan by — ^-t-iHnj an aasumed tliHrntisn 
of the lest kaa^a. 

Gfoi^ VII. elataKs) 35-36. drawn to apparatus for verifying an idaolity of a penon by oomparing a last daU with 
reference data to fonn a test stsHslirs as the ratio. 



The inventioos listed as Qroupa I-VIl do noi relato to a aiogle inventive oonoept under PCT Rule 13. 1 becaiMc. under 
per Rule 13.2, they lack the aame ooneapondiag special teohniral foatures for the folfowing leewms: the special 
Innh n in a l foatura of the Groiqp 1 invention ia mrsns for extncting an satioBato of nriTir variaaoe in the tost data as a 
function of poaitinn in the teat image; the apeoial technical feature of lha Qroup U ■ms^iiin m -\Timi firr ilrrr by, 

imAiUiwJ tot AMtM i — i 1: — ^ ^ — i^i .^i.-:^! ^ririy III Mi irn M rinn m thf 

means far estproaaiog the test daU and the referenoe dato in the fonn of loeal sinusoids; the special tmhniral feature of 
the Group IV mvention is the meana for deriving from the rafereaoe daU a onp of ridge ifiaemg and diractkMi; the 
special t rrhn i rsi festura of the Group V invention is the means for ^^»*s*»g the sffrmnrd diUtion of the test imsge 

ralative to a reforenoe image; the special teohnkisi feature of the Group VI in 181111 ■ m the for — — m 

assumed distortion of the test imags; and the apooial teohnicnl feature of the Groiy VII mvention m the means for 
oon^Muring teit daU with the referenoe daU to f«ma a test statastio as the ratio. Sinre the special featore of any 

one Group is ixit present in any of the other Groups, unity of invention is lacking. 



Form PCT/ISA/210 (extra fheel)(iuly 19W)* 



BNeOOCID: '<MO_jBei03raA1JL> 



